Senior Data Engineer - Databricks

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Network, we combine deep expertise in AWS, artificial intelligence, and Anthropic’s Claude platform to help customers modernize their technology, build intelligent products, and move AI from experimentation into production. Our capabilities span generative and agentic AI, cloud migration and modernization, cloud-native application development, data and analytics, DevOps, managed services, security and compliance, and customer experience transformation. At Caylent, our people always come first. We are a fully remote global company with employees in Canada, the United States and Latin America. We celebrate the culture of each of our team members and foster a community of technological curiosity. Come talk to us to learn more about what it means to be a Caylien! The Mission At Caylent, a Senior Data Engineer is an integral part of a cross-functional delivery team implementing data management solutions on AWS for our customers. You will work hands-on to define RDS data sources, develop ETL jobs, and manage data warehouses and lakehouse platforms, including Databricks-based environments. You will participate in daily standups with your team and in regular agile ceremonies with the customer. Your manager will meet with you weekly for a 1:1 to guide your career and help you make the most of your time at Caylent. Your Assignment Deliver complex data platform components or migration solutions independently Troubleshoot performance, scalability, and reliability issues Contribute to solution design and engineering standards Communicate technical topics clearly to peers and stakeholders Produce high-quality documentation and implementation reviews Required Technical Competencies: Platform Development Focus: Strong experience building scalable cloud-native data platforms and pipelines Advanced knowledge of modern data lake/lakehouse practices Hands-on experience with distributed processing (Spark/PySpark or equivalent) Hands-on experience with Databricks, including notebooks, job orchestration, Delta Lake, and working knowledge of Unity Catalog, or a comparable managed lakehouse platform Experience with streaming or event-driven ingestion patterns Python with solid engineering principles (OOP, testing) Migration & Modernization Focus: Strong expertise in relational databases and schema design Advanced query optimization and performance troubleshooting Experience executing large-scale migrations and modernization efforts, including migrations onto Databricks Knowledge of HA/DR patterns, security, and cost optimization Automation and scripting for migration workflows Across Both: Infrastructure-as-code and CI/CD integration Cloud security fundamentals Cost-aware design Experience Requirements: 4+ years of RDBMS or big data engineering experience 2+ years of AWS-based implementations 1+ years of hands-on Databricks experience (or equivalent lakehouse platform) Language: Upper-Intermediate English (minimum B2) Benefits 100% remote work Generous holidays and flexible PTO Competitive phantom equity Paid for exams and certifications Peer bonus awards State of the art laptop and tools Equipment & Office Stipend Individual professional development plan Annual stipend for Learning and Development Work with an amazing worldwide team and in an incredible corporate culture NOTE: We’re unable to provide visa sponsorship now or at any time in the future. At Caylent, we are committed to fair, transparent, and inclusive hiring practices. As part of our recruitment process, we may use artificial intelligence (AI) tools or automated systems to assist with the screening and evaluation of applications to help match candidate qualifications with job requirements. These tools are designed to support — not replace — human decision-making. Final hiring decisions are always made by our trained recruitment professionals. If an AI or automated tool is used during your application process, it will only be in accordance with applicable laws and regulations, and your information will be handled in a secure and confidential manner. If you have any questions, please contact [email protected] Caylent is a place where everyone belongs . We celebrate diversity and are committed to creating an inclusive environment for all employees. Our approach helps us to build a winning team that represents a variety of backgrounds, perspectives, and abilities. So, regardless of how your diversity expresses itself, you can find a home here at Caylent. We are proud to be an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, color, religion, national origin, sex (including pregnancy), sexual orientation, gender identity, gender expression, age, veteran status, genetic information, disability, or other applicable legally protected characteristics. If you would like to request an accommodation due to a disability, please contact us at [email protected].