Senior Data Engineer Job at New York Technology Partners, Houston, TX

YkVTL1pYS1JLYTNtbzdBYVRWQmZEbFpzWFE9PQ==
  • New York Technology Partners
  • Houston, TX

Job Description

We are seeking a Senior Data Engineer to support the advancement of data governance and data management capabilities within a modern Databricks Lakehouse environment. This is a hands-on engineering role focused on building, automating, and operationalizing scalable data solutions using code and AI-driven approaches.

This role is ideal for someone who enjoys turning frameworks into real, production-ready systems that improve data quality, trust, and accessibility across the organization.

**Remote but requires someone willing to come onsite 2 times per month (Houston, TX)**

Key Responsibilities

  • Implement data governance and data management solutions within Databricks, including Unity Catalog, access controls, metadata, and data quality frameworks
  • Translate governance frameworks into scalable, production-ready engineering solutions
  • Build and optimize advanced data pipelines using Databricks, DBT, and Kafka
  • Develop reusable templates, automation, and standardized patterns to enable broader adoption across teams
  • Design and implement AI/GenAI-enabled solutions (e.g., metadata enrichment, automated data quality checks, intelligent workflows)
  • Monitor and report on data quality and governance health using SQL and reporting tools such as Power BI
  • Collaborate with engineering, architecture, and business stakeholders to drive adoption and maturity of data practices
  • Troubleshoot, optimize, and performance-tune data pipelines and streaming systems

Required Qualifications

  • Strong experience as a Data Engineer or Software Engineer in a production environment
  • Hands-on experience with Databricks, including Unity Catalog
  • Experience building and optimizing data pipelines using tools such as DBT and Kafka
  • Strong SQL skills and experience working with large-scale data systems
  • Experience with data governance concepts, including metadata management, access control, and data quality frameworks
  • Experience with performance tuning in Databricks and/or Kafka environments
  • Familiarity with AWS or similar cloud platforms
  • Strong communication skills with the ability to work directly with stakeholders and drive initiatives independently

Job Tags

Remote work

Similar Jobs

Lifetech Resources

Accounts Receivable Clerk Job at Lifetech Resources

 ...of the financial team, the AR Clerk performs a wide range of accounting and administrative duties to support the accounting department...  ...accurate accounts. Verify information and maintain accounts receivable reports Interact and follow up with customers, staff, and department... 

Midland-Marvel Recruiters, LLC

Maintenance Manager Job at Midland-Marvel Recruiters, LLC

 ...plastics company with multiple manufacturing locations has an outstanding opportunity available in the Phoenix, AZ area for a Maintenance Manager. QUALIFICATIONS High School Diploma or GED and three to seven years related experience. This position will have 5 direct... 

Creative Circle

Accessories Product Designer (Belts and Leather) Job at Creative Circle

 ...Our client is a distinguished fashion wholesale company that supplies the nation's leading retailers with private label accessories. They are currently seeking a Fashion Accessories/Handbag Designer who excels at translating current trends into market-ready product designs... 

Family Resource Home Care

Part-Time Registered Nurse Job at Family Resource Home Care

 ...Part TimeRegistered Nurse (RN) Nurse Delegation Trainer (WA DSHS) Job Summary Family Resource Home Care is seeking a Registered Nurse (RN) to provide training and proctoring for the Washington DSHS Nurse Delegation course. In this role, you will support caregivers... 

Pentangle Tech Services | P5 Group

Industrial Engineer Job at Pentangle Tech Services | P5 Group

 ...Industrial Engineer - Location: Appleton, WI 54914, United States Number of positions: 5 Need onsite Offshore coordination experience. Key words - Shopfloor Experience is mandatory - Time Study - Line Balancing - Continuous Improvement - VSM -...