Background

Founded in 2021 and coming out of Y Combinator, OneSchema offers a tool that simplifies managing CSV data through a user-friendly interface. It includes features for error detection and correction, enhancing the efficiency of data uploads for systems requiring structured data formats.

Product and engineering teams use OneSchema to save months of development time to build a CSV importer. OneSchema improves customer activation / import completion rates by automatically correcting customer data.

OneSchema Challenges

As OneSchema grew, they faced challenges with Heroku, particularly as they outgrew the platform's free tier and required more advanced features like multi-region hosting to comply with EU data residency laws. The primary issues were centered on scalability, the necessity for multi-region support, and maintaining compliance with SOC 2, HIPAA, and GDPR standards. OneSchema's engineering was focused on developing their core product–an embeddable CSV importer that improves the efficiency and accuracy of managing CSV data. 

DuploCloud Solutions

To address these challenges, OneSchema partnered with DuploCloud, attracted by DuploCloud's robust capabilities in managing complex infrastructure requirements. This partnership facilitated their migration to Kubernetes platform, enabling OneSchema to deploy non-production and production clusters, stabilize the applications, and build CICD automation using GitHub Actions within weeks. OneSchema also utilized DuploCloud’s built-in monitoring, logging, and alerting features to meet their Production quality and availability targets.

As their operations expanded to other AWS regions, they used DuploCloud tools like TErraform exporter to replicate environments efficiently. This expedited the creation of new environments, significantly speeding up their delivery times. Compliance and security were paramount for OneSchema, requiring immediate SOC 2 compliance upon deploying their production infrastructure. DuploCloud provided SOC 2-ready infrastructure out of the box and collaborated closely with OneSchema to meet audit requirements and timelines. Integration with AWS security services and the Wazuh SIEM enabled timely compliance with SOC 2 standards.

Impact

The partnership between OneSchema and DuploCloud has had substantial impacts, enhancing operational efficiency and compliance adherence. By adopting DuploCloud’s managed services for Terraform and Kubernetes, OneSchema significantly reduced the need for dedicated DevOps resources, streamlining their operations and decreasing overhead costs.

This operational efficiency allowed the team to focus more on product development and enhancing customer service. The migration facilitated compliance with stringent regulations, including SOC 2, HIPAA, and GDPR, across multiple regions—a crucial factor for attracting and retaining customers in regulated industries such as health tech and legal tech.

The ability to easily replicate infrastructure across various regions without significant downtime or complexity has notably increased OneSchema's scalability and flexibility, enabling them to expand services globally. This scalability supports their EU data residency initiatives and paves the way for similar expansions into other regions, broadening their market reach.

Establishing a true staging environment has improved the stability of OneSchema’s products. Testing in a staging environment before production deployment has minimized the risks associated with new releases, leading to higher product quality and enhanced customer satisfaction. These benefits underscore the strategic value of the partnership in supporting OneSchema's ability to meet future demands while maintaining a robust, compliant infrastructure.

Technical Implementation

The AWS data platform was selected as a comprehensive solution for ingesting, processing, analyzing, and presenting data generated by OneSchema’s systems, processes, and infrastructure. OneSchema’s applications benefit from all aspects of their data platform implementation on AWS, utilizing key services such as:

• AWS CloudShell 
• AWS CloudTrail 
• AWS Config 
• AWS Cost Explorer 
• AWS IoT 
• AWS Key Management Service 
• AWS Lambda 
• AWS Secrets Manager 
• AWS Security Hub 
• AWS Step Functions 
• AWS Transfer Family 
• CloudFront 
• CloudWatch 
• CloudWatch Events 
• DynamoDB 
• EC2 - Other 
• EC2 Container Registry (ECR) 
• Elastic Compute Cloud - Compute 
• Elastic Container Service for Kubernetes 
• Elastic Load Balancing 
• ElastiCache 
• GuardDuty 
• Inspector 
• Relational Database Service 
• Route 53 
• Simple Notification Service 
• Simple Queue Service 
• Simple Storage Service 
• Virtual Private Cloud