[Remote] Senior Data Engineer/Architect - Databricks

Note: The job is a remote job and is open to candidates in USA. Greystar is a leading, fully integrated global real estate platform offering expertise in property management, investment management, development, and construction services. They are seeking a Senior Data Engineer/Architect to join their D2AI team, focusing on leveraging Azure SQL, Cosmos DB, and Databricks to meet growing data demands and support customer-facing applications.

Responsibilities

• 100% hands-on development – Azure SQL, Cosmos DB, Databricks, and Azure OpenAI: develop and unit test database and AI pipeline code, including T-SQL, stored procedures, functions, views, and LLM prompt orchestration layers
• Own and maintain the Databricks data ingestion & output pipelines for end programs such as greystar.com and Microsoft Customer Insights CDP platform, including Delta Lake table optimization, schema evolution, and medallion architecture (Bronze/Silver/Gold) design
• Architect and maintain AI-ready data structures — clean, well-typed, and optimized for feature engineering and model consumption
• Participate in the design of databases and feature stores, applying normalization or denormalization as appropriate to support both operational and ML workloads
• Create, deploy, and maintain ADF and Databricks Workflows pipelines, adhering to Greystar's standards and documented best practices
• Perform analysis of complex data and document findings, leveraging AI-assisted tooling and notebooks to surface insights faster
• Prepare and curate data for prescriptive and predictive modeling — including feature extraction, data labeling pipelines, and training/test dataset construction
• Combine raw data from disparate external sources; build and support complex ingestions including real-time streaming (Event Hub) and batch patterns
• Collaborate closely with data scientists, ML engineers, and application developers consuming the data — ensuring outputs are well-documented, versioned, and model-ready
• Integrate and support AI/ML model outputs back into data products — scoring pipelines, inference result storage, and feedback loops for model monitoring
• Play a direct role in the maintenance, technical support, documentation, and administration of databases and Databricks environments, including Unity Catalog governance
• Ensure standards are followed by participating in code reviews — including review of AI prompt logic, notebook structure, and pipeline configuration
• Act as a thought leader: bring forward new ideas in AI, data engineering, and LLM integration — and then build them

Skills

• 6+ years relevant and progressive data engineering experience
• Deep Technical knowledge and experience in Microsoft Azure architecture, including Azure PaaS databases, Synapse, ADF pipelines, Azure functions, Event Grids etc
• 3+ Years of Experience with Cosmos DB
• 3+ Years of Experience with Data Bricks
• Hands-on skills working with data pipelines using SQL and No-SQL databases
• Minimum of 1 year of relevant experience working with Azure Data Lakes Gen 2
• Experience with Power Platform / Power BI
• Experience in engineering practices such as code refactoring, design patterns, CI/CD, and highly scalable data applications
• Experience developing batch ETL pipelines; real-time pipelines are a plus
• Knowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing, structured and unstructured data
• Good Experience with Python, machine learning frameworks and statistics
• Knowledge of Agile software development process
• Excellent problem-solving skills and experience
• Strong communication and collaboration skills
• "Self-starter" attitude and the ability to make decisions with minimal guidance from others
• Innovative and passionate about your work and the work of your teammates
• Ability to comprehend and analyze operational systems and ask appropriate questions to determine how to improve, migrate or modify the solution to meet business needs
• Experience / Familiarity with D365 Customer Insights platform / Dataverse is a plus
• Databricks or other Certifications are nice to have but not required
• Advanced degree preferred

Benefits

• Competitive pay, benefits, and overall compensation packages.
• 100% Remote flexibility!
• Corporate Positions: In addition to the base salary, this role may be eligible to participate in a quarterly or annual bonus program based on individual and company performance.
• Onsite Property Positions: In addition to the base salary, this role may be eligible to participate in weekly, monthly, and/or quarterly bonus programs.
• Competitive Medical, Dental, Vision, and Disability & Life insurance benefits.
• Low (free basic) employee Medical costs for employee-only coverage; costs discounted after 3 and 5 years of service.
• Generous Paid Time off.
• All new hires start with 15 days of vacation, 4 personal days, 10 sick days, and 11 paid holidays.
• Plus your birthday off after 1 year of service!
• Additional vacation accrued with tenure.
• For onsite team members, onsite housing discount at Greystar-managed communities are available subject to discount and unit availability.
• 6-Week Paid Sabbatical after 10 years of service (and every 5 years thereafter).
• 401(k) with Company Match up to 6% of pay after 6 months of service.
• Paid Parental Leave and lifetime Fertility Benefit reimbursement up to $10,000 (includes adoption or surrogacy).
• Employee Assistance Program.
• Critical Illness, Accident, Hospital Indemnity, Pet Insurance and Legal Plans.
• Charitable giving program and benefits.
• Benefits offered for full-time employees.
• For Union and Prevailing Wage roles, compensation and benefits may vary from the listed information above due to Collective Bargaining Agreements and/or local governing authority.

Company Overview