Data Engineer

data engineer

Roles and Responsibilities

  • Work with the Trading, Sales, and other internal functions, and external vendors to turn large-scale, diverse, structured and unstructured data into a source of meaningful customer insights
  • Design and implement data management, quality monitoring, and cleaning processes to ensure data accuracy
  • Design and develop ETL pipelines to ingest the data in variable formats, structured and unstructured.
  • Design and implement complex & advanced data warehouse & data models
  • Develop automation for the teams to utilize databases/Big data platforms
  • Manage data vendor/customer relationships

Qualifications

  • Bachelor / MS degree in Computer Science, Applied Mathematics, Engineering, Information Technology or any other technology related field.
  • 1-3 years of relevant experience in Data Engineering
  • Proficiency with at least one of leading cloud computing platforms (GCP, AWS, Azure)
  • Proficiency with one or more programming/scripting languages, primarily Python and SQL
  • Experience in creating new processes for data transformation, data structures, metadata, and workload management.
  • Experience in application & data architecture, system, and software design