Epsilon Women in Tech Data Engineer Hiring Challenge

Brief Description of Role:

Developing end-to-end Data Engineering solutions for the clients which involve Data ingestion and Data Integration to the CDP Platform, working with both stream and batch data. Build Data/ETL pipelines and Custom APIs and be able to work with various datasets SQL/NoSQL, JSON and REST data. Experience in collection, storage, processing, analysis and visualization of Cloud data services on any of the cloud platforms.

Technical/Functional Qualifications:

This position requires an individual with a combination of software engineering and data analytical skills with the desire to be part of cutting-edge, high-profile projects and are motivated by delivering world-class solutions on an aggressive schedule. The candidate should have a solid foundation in computer science with well-honed skills in data engineering. 

We are looking for an experienced  Data Engineer with knowledge of the CDP platform who will develop and build solutions for major Auto parts companies in the market.

Qualification

The followings are required:

• Data Engineer with experience in building ETL / Data pipelines.
• Hands-on experience in building REST APIs, and microservices.
• Should have worked on streaming data and data integration on other platforms.
• Basic knowledge of ML Models and feature engineering.
• Good to have hands-on experience on the Adobe Experience Platform. Should be able to create Schema, Customer Profile and Audience segmentation.
• Should have worked on monitoring, scheduling, orchestration of jobs and validating daily data ingestions to downstream.
• Develop, document, and test software and environment setup to ensure that the outcome meets the needs of end-users and achieves business goals
• Work with various business and technical people to understand the systems, data sources, business goals, technical goals, and timelines on multiple projects
• Experience setting up CI/CD pipeline.
• Experience in ETL and Audience segmentation.
• Tech stack- any cloud platform, Python and SQL.
• Familiarity with the software development methodology.
• Attention to detail in design, documentation and test coverage of what you build
• Collaborate with business stakeholders to identify and meet data requirements.
• Familiarity with software development methodology such as Agile/Scrum/Kanban
• Good to have worked on any of the below CDP tools
  Tealium Audiencestream, Salesforce CDP/Interaction Studio, ActionIQ,M-Particle

In addition, the candidate should have strong business acumen, and interpersonal and communication skills, yet also be able to work independently. He/she should be able to communicate findings and the way techniques work in a manner that all stakeholders, both technical and non-technical, will understand. 

Conditions of Employment

All job offers are contingent upon the successful completion of background checks.

Great People, Deserve Great Benefits

We know that we have some of the brightest and most talented associates in the world, and we believe in rewarding them accordingly.  If you work here, expect competitive pay, comprehensive health coverage, and endless opportunities to advance your career.  We offer associates a variety of benefits that work as hard for them as they work for us. 

Brief Description of Role:

Delivering integrated marketing solutions focused on relevant, personalized, and cross-channel technologies is paramount at Epsilon. This position will focus on the development and integration of data onto multiple platforms, becoming the expert on Decision Management platforms while providing support and backup to other channels when needed. The communication skill to understand the business requirement, walk through the complex design with simple examples, demonstrate why the system is working and clarify the performance outcome with the customer is equally important.

You will develop and integrate the decision management capabilities.  Client integration will come in many forms including customer websites, call centers, email systems, mobile applications, print channels, and many other customer touchpoints.

This is a highly visible position directly working with Epsilon’s client base. We are looking for a development professional to manage this initiative and important opportunity.

Below are the primary responsibilities

• System Integration:  You will need to be able to develop, and integrate decision management platforms into multiple types of marketing applications such as website, email, print, social, etc.  Below is a list of detailed responsibilities: 
  • Development of API, Rest services, Web services, and other common network communication protocols
  • Recommendation model development and integration
  • Integration with Java, Python, .NET, HTML, and many other marketing platforms
  • Development of ETL, XML, SFTP, shell script and other data transformation processes

• Client Services and Support: You will need to be able to work in a cross matrix team environment from both Epsilon and our client base including; peer developers, project managers, systems analyst, database developers, marketing teams, business managers, and executive leadership. Work closely for all IT development and integration work with the client.. Implement critical processes needs for the client. Prepare and maintain documentation including planning, analysis, design, implementation/testing, and deployment deliverables.  Execute as per timelines and coordination among sub-projects; ensure that cross-project dependencies are identified, communicated, and tracked. Refine and implement quality test plans. 

Technical/Functional Qualifications:

This position requires an individual with a combination of software engineering and data analytical skills with the desire being part of cutting-edge, high-profile projects and are motivated by delivering world-class solutions on an aggressive schedule. The candidate should have a solid foundation in computer science with well-honed skills in data engineering. 

We are looking for an experienced Azure data engineer who will develop and build a marketing data mart for a major pharmaceutical company in the market.

• Should have a comprehensive understanding of services on the Azure data platform
• Supports ADF pipelines – Builds the required dimensions, rules, segments and aggregates
• Support all database operations: performance monitoring, pipeline ingestion, maintenance, etc.
• Develop new inbound data sources required within the Marketing Data Mart to support campaign creation
• Monitor DataMart health - data loads, extracts, failures, performance tuning
• Create/modify data structures/pipelines
• Salesforce Marketing Cloud support
• Supports daily processing, monitoring and loading for all data updates
• Always take all software best practices into consideration. Ex. infrastructure cost, security, scalability, feature extensibility, ease of maintenance, etc.
• Develop, document, and test software and environment setup to ensure that the outcome meets the needs of end-users and achieves business goals
• Work with various business and technical people to understand the systems, data sources, business goals, technical goals, timelines on multiple projects

Qualification

The followings are required:

• Strong analytical, written and verbal communication skills.
• Tech Stack: ADF pipeline, Databricks, Python, SQL, PL-SQL, SSIS
• Develop Azure logic apps
• Strong Experience in development of Azure Datalake solutions
• Must have experience in developing serverless applications using Azure function apps
• Experience with Azure Data Factory, Databricks, Spark, or other cloud ETL technologies preferred.
• Extensive experience in ETL and audience segmentation
• Experience in designing and building data ingestion pipelines both real-time and batch using best practices
• Connect to different source systems and collect the data in scheduled time and process them using different components like Azure Data bricks, Function Apps, Logic apps etc., and distribute it to the downstream applications or downstream locations like Azure SQL/Synapse, Amazon S3/RedShift etc.
• Knowledge on setting up automated test suites for ETL pipelines
• Experience setting up CI/CD pipelines for ETL projects
• Attention to detail in design, documentation and test coverage of what you build
• Collaborate with business stakeholders to identify and meet data requirements.
• Familiarity with software development methodology such as Agile/Scrum/Kanban
• Implementing incremental data load
• Strong experience in SQL analytic queries

In addition, the candidate should have strong business acumen, and interpersonal and communication skills, yet also be able to work independently. He/she should be able to communicate findings and the way techniques work in a manner that all stakeholders, both technical and non-technical, will understand.

Conditions of Employment

All job offers are contingent upon the successful completion of background checks.

Great People, Deserve Great Benefits

We know that we have some of the brightest and most talented associates in the world, and we believe in rewarding them accordingly.  If you work here, expect competitive pay, comprehensive health coverage, and endless opportunities to advance your career.  We offer associates a variety of benefits that work as hard for them as they work for us.