JR. Data Engineer
Day-to-Day:
Insight Global's client is looking for a Data Engineer to enter their data science team.
This candidate will not work with big data but rather working with large data sets (a few terabytes) from different sources.
They will be working with the internal application team extensively.
They will be using java and python to connect data sources and ensure transformation jobs.
Some other responsibilities and duties include:
o Contributing to the development of a newly established data warehouse ecosystem o Communicating effectively and defining requirements from a wide range of different teams o Translating business requests into database design and execution o Working closely with domain experts to understand the source systems of the data o Building robust and scalable interfaces, ETL programs, and data pipelines o Developing and maintaining data dictionary for published data sources o Developing and improving data release and testing processes o Creating and managing data sources and integrate with numerous APIs o Ability to identify and resolve performance issues o Operating in an open source and cloud based environment that includes:
AWS, Redshift, Azure, Python, R, Hadoop, Spark, and other technologies o Working with structured and unstructured dataPlusses:
o Bachelors degree o AWS certifications o Alteryx for connectivity o Snowflake o Cloud experience AWS (Glue and data brew) o Familiarity with AWS, AWS Lambda, S3, Redshift, MongoDB, Graph Databases, Azure, and other cloud-based technologiesMust Haves:
o Two years in Data Engineering in a cloud environment developing ETL tools o Data Governance o Structured data o Comfortability with handling multiple data sources and variants o Reading/writing database management skills - Python, SQL API experience Recommended Skills Api Aws Lambda Amazon Redshift Amazon S3 Apache Hadoop Apache Spark Estimated Salary: $20 to $28 per hour based on qualifications.
Insight Global's client is looking for a Data Engineer to enter their data science team.
This candidate will not work with big data but rather working with large data sets (a few terabytes) from different sources.
They will be working with the internal application team extensively.
They will be using java and python to connect data sources and ensure transformation jobs.
Some other responsibilities and duties include:
o Contributing to the development of a newly established data warehouse ecosystem o Communicating effectively and defining requirements from a wide range of different teams o Translating business requests into database design and execution o Working closely with domain experts to understand the source systems of the data o Building robust and scalable interfaces, ETL programs, and data pipelines o Developing and maintaining data dictionary for published data sources o Developing and improving data release and testing processes o Creating and managing data sources and integrate with numerous APIs o Ability to identify and resolve performance issues o Operating in an open source and cloud based environment that includes:
AWS, Redshift, Azure, Python, R, Hadoop, Spark, and other technologies o Working with structured and unstructured dataPlusses:
o Bachelors degree o AWS certifications o Alteryx for connectivity o Snowflake o Cloud experience AWS (Glue and data brew) o Familiarity with AWS, AWS Lambda, S3, Redshift, MongoDB, Graph Databases, Azure, and other cloud-based technologiesMust Haves:
o Two years in Data Engineering in a cloud environment developing ETL tools o Data Governance o Structured data o Comfortability with handling multiple data sources and variants o Reading/writing database management skills - Python, SQL API experience Recommended Skills Api Aws Lambda Amazon Redshift Amazon S3 Apache Hadoop Apache Spark Estimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
