Senior Technical Consultant, Data
AHEAD is looking for a Senior Data Engineer to work closely with our dynamic project teams (both on-site and remotely). This Senior Data Engineer will be responsible for strategic planning and hands-on engineering of Big Data and cloud environments that support our clients’ advanced analytics, data science, and other data platform initiatives. This consultant will design, build, and support modern data environments that reside in the public cloud or multi-cloud enterprise architectures. They will be expected to be hands-on technically, but also present to leadership, and lead projects.
The Senior Data Engineer will have responsibility for working on a variety of data projects. This includes orchestrating pipelines using modern Data Engineering tools/architectures as well as design and integration of existing transactional processing systems. As a Senior Data Engineer, you will design and implement data pipelines to enable analytics and machine learning on rich datasets.
Roles and Responsibilities
- A Data Engineer should be able to design, build, operationalize, secure, and monitor data processing systems
- Create robust and automated pipelines to ingest and process structured and unstructured data from various source systems into analytical platforms using batch and streaming mechanisms leveraging cloud native toolset
- Implement custom applications using tools such as Kinesis, Lambda and other cloud native tools as required to address streaming use cases
- Engineers and supports data structures including but not limited to SQL and NoSQL databases
- Engineers and maintain ELT processes for loading data lake (Snowflake, Cloud Storage, Hadoop)
- Engineers API’s for returning data from these structures to the Enterprise Applications
- Leverages the right tools for the right job to deliver testable, maintainable, and modern data solutions
- Respond to customer/team inquiries and assist in troubleshooting and resolving challenges
- Works with other scrum team members to estimate and deliver work inside of a sprint
- Research data questions, identifies root causes, and interacts closely with business users and technical resources
Qualifications
- 8+ years of professional technical experience
- 4+ years of hands-on Data Architecture and Data Modelling.
- 4+ years of experience building highly scalable data solutions using Hadoop, Spark, Databricks, Snowflake
- 4+ years of programming languages such as Python
- 2+ years of experience working in cloud environments (AWS and/or Azure)
- Strong client-facing communication and facilitation skills
Key Skills
- Python, Cloud, Linux, Windows, NoSQL, Git, ETL/ELT, Spark, Hadoop, Data Warehouse, Data Lake, Snowflake, SQL/RDBMS, OLAP, Data Engineering
Similar Jobs
-
-
SanMar Employee Board
SanMar Employee Board
-
Instrumentation and Controls Technician
Veolia WTS
-
-
SanMar Employee Board
SanMar Employee Board
Instrumentation and Controls Technician
Veolia WTS
