Junior Data Engineer - Databricks
Citco is a global leader in financial services, providing specialist services to investment funds and private clients. As a Junior Data Engineer, you will contribute to the Centralized Data Platform, building data pipelines and ensuring data quality while collaborating with various stakeholders.
Responsibilities
- Develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analytics
- Develop and optimize ETL/ELT pipelines
- Utilize Delta Live Tables for data ingestion and transformations
- Apply Unity Catalog features and IAM best practices for security governance and access control
- Support infrastructure and resource management using Terraform
- Participate in Agile/Scrum development process and collaborate with team members
- Implement monitoring solutions for pipeline performance and data quality
Skills
- 1+ years of experience in data engineering
- Experience with Python and familiarity with Spark programming
- Demonstrable experience in using AI in development
- Experience with AWS or other similar cloud services
- Understanding of data modeling and SQL
- Familiarity with the Databricks platform
- Experience with version control systems (Git)
- Strong problem-solving and analytical skills
- Excellent communication and collaboration abilities
- Financial services industry experience
- Proven ability to learn and apply new technology
- Active interest in emerging technologies and industry trends
- Experience implementing complex data solutions
- Track record of continuous learning and skill development
- Strong technical documentation abilities
- Experience using AI tools to enhance productivity
Benefits
- A range of benefits
- Training and education support
- Flexible working arrangements
Company Overview