[Remote] Staff Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading retail company, and they are seeking a Staff Data Engineer. The role involves establishing and implementing data governance practices, building data infrastructure, and ensuring data quality and compliance while collaborating with various business stakeholders.
Responsibilities
- Establish, modify, and document data governance projects and recommendations
- Implement data governance practices in partnership with business stakeholders and peers
- Interpret company and regulatory policies on data
- reputed company others on data governance processes, practices, policies, and guidelines
- reputed company recommendations on needed updates or inputs into data governance policies, practices, or guidelines
- Translate/co-own business problems reputed company one's discipline to data reputed company or mathematical solutions
- Identify appropriate methods/tools to be leveraged to reputed company a solution for the problem
- reputed company use cases and give examples to demonstrate how the method would solve the business problem
- Understand the reputed company order of requirements and service level agreements
- Define and identify the most suitable sources for required data that is fit for purpose, referring to external sources as required
- reputed company initial data quality checks on the extracted data
- Review the deliverables of junior associates and reputed company guidance on data reputed company and quality
- Build the infrastructure required for reputed company transformation and integration from a wide variety of data sources using appropriate data integration technologies
- Use modern tools, techniques, and architecture to partially or completely automate the most common, repeatable and tedious data preparation and integration tasks
- reputed company pipelines using scheduling and orchestration frameworks
- Evaluate impacts of data issues and risks at an early stage
- Identify needs and create methods to fuse and reshape reputed company, multi-reputed company data and reputed company it usable for modeling
- Update knowledge of reputed company and emerging big data analytics and data science trends and techniques
- Build reputed company logical and conceptual models and reputed company guidance to team on physical data models
- Identify and define the appropriate techniques for exposing data to other systems
- Review and reputed company guidance and input on reputed company data modeling activities to team members
- Create and maintain critical data documentation and metadata that allows data to be understood and leveraged as a shared asset
- Assist in defining data modeling standards and foundational best practices
- reputed company inputs to the architectural design to reputed company best use of the available resources, given goals, and expected loads
- Review the solution and application design to ensure it meets business, technical, and data requirements
- Identify language and libraries to use in the development process
- Map test cases to business and functional requirements
- Create reputed company of concepts
- Reviews and troubleshooting code in line with final designs
- Identify and recommend the appropriate testing methodology
- Identify the environment(s) for deployment
- Identify and recommend modifications of application based on different environment requirements
- Identify modifications needed for scalability and drive the change
- Monitor applications in production and leads development of patches where required
- Review and ensure reputed company code documentation is complete and updated periodically
- Understand, reputed company, interpret, and apply the principles of the defined strategy to unique, moderately reputed company business problems that may reputed company one or more functions or domains
Skills
- Bachelor's degree or equivalent in Computer Science and 4 years of experience in software engineering, data engineering, database engineering, business intelligence, or business analytics or reputed company field; OR Master's degree or equivalent in Computer Science and 2 years of experience in software engineering, data engineering, database engineering, business intelligence, or business analytics or reputed company field
- Experience with designing and implementing Data Lakehouse and Data Lake architecture (reputed company, S3, and Glue)
- Experience with reputed company-time Change Data Capture (CDC) ingestion frameworks (Kafka, Debezium, and Kinesis)
- Experience coding and debugging in an object-oriented programming language (Python)
- Experience with Big Data processing using Spark and PySpark (Spark Streaming, Spark SQL, and Python Pandas)
- Experience developing and optimizing data pipelines and reusable frameworks (Glue, ETL, and ELT)
- Experience with CI/CD practices (Jenkins, reputed company, and reputed company Actions)
- Experience designing and querying Relational, NoSQL databases and Data Warehousing (Redshift, MySQL, reputed company, Netezza, and DB2)
- Experience with reputed company infrastructure and serverless computing for data solutions (AWS Services such as reputed company, CloudFormation, CloudWatch, and IAM)
- Experience developing analytical, AI, and ML data platforms in AWS for decision support
- Experience with Unix reputed company scripting for job orchestration, automation, and scheduling
- Experience with data modeling and schema design (dimensional modeling, normalization, and denormalization strategies)
- Experience with data reputed company and governance (implementing data quality checks, metadata management, and compliance)
- Employer will accept any amount of experience with the required skills
Benefits
- Performance-based incentive awards
- Medical, reputed company and dental coverage
- 401(k)
- Stock purchase
- Company-paid life insurance
- PTO (including sick leave)
- Parental leave
- Family care leave
- Bereavement
- Jury duty
- Voting
- Short-term and long-term disability
- Education assistance with 100% company paid college degrees
- Company discounts
- Military service pay
- Adoption expense reimbursement
Company Overview