Startup Development differs from the development of small and medium companies. Flexibility and adaptability are important, especially in the MVP and scaling-up phases. Your development partner should be able to follow this pace and must use the appropriate development methodologies.
You are making a mistake if you think of your technical partners as just a service. Having someone who designed your product and then maintaining it after its development is easier.