Brillio logo

Databricks Architect - R01573990

Hiring from
United States
Work type
Hybrid
Posted

626,551 remote jobs, straight from company career pages

100% free · New jobs every minute

Show job description
Data Architect

Primary Skills

  • ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
  • Specialization

  • Databricks Engineering: Data Architect
  • Job requirements

  • Location: San Jose, CA
  • Looking for candidate local to CA
  • Full-time role, does not open for a sponsorship.
  • Experience Range: With at least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms

    Key Responsibilities:
    1. Design and architect scalable, high-performance data solutions utilizing Databricks and leading cloud data platforms
    2. Develop, optimize, and maintain ETL pipelines with SQL, Python, and Databricks to ensure efficient data ingestion, transformation, and loading
    3. Implement robust data models and data warehousing solutions to drive analytics, reporting, and business intelligence outcomes
    4. Automate and streamline data workflows to enhance system efficiency and minimize processing times
    5. Monitor, troubleshoot, and resolve performance bottlenecks in data pipelines and platform components
    6. Ensure data quality, consistency, and security across all data assets and platforms
    7. Collaborate with cross-functional teams to translate business requirements into technical data architecture solutions
    8. Document architecture designs, data flows, and best practices to support operational excellence and knowledge sharing

    Required Skills:
    1. Advanced proficiency with Databricks platform and ecosystem
    2. Expertise in designing and developing ETL pipelines using SQL and Python
    3. Expert-level SQL, including advanced query optimization
    4. Proficiency in Python for data engineering and automation
    5. Comprehensive knowledge of data warehousing concepts and design patterns
    6. Experience with data modeling techniques and best practices
    7. Hands-on experience with PLSQL and T-SQL
    8. Ability to develop and maintain stored procedures for data transformation
    9. Experience with performance tuning and troubleshooting in distributed data environments

    Preferred Skills:
    1. Experience with Azure Data Lake, AWS S3, or Google BigQuery
    2. Familiarity with Delta Lake and lakehouse architecture concepts
    3. Knowledge of CI/CD practices for data engineering pipelines
    4. Working experience with Scala or Java in data engineering contexts
    5. Exposure to data governance, cataloging, and lineage tools

    Desired Qualifications:
    1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline
    2. Databricks Certified Data Engineer Associate or Professional certification
    3. Certification in cloud data platforms such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer

  • Apply for this job100% free