Data Engineer

Charlotte, NC

Company Name :Ibainfotechinc

Type : contract

Primary Skills : Lambda, Glue, Data Pipeline, Redshift, Aurora

Location : Charlotte

CTC : DOE

Job Description:

Work you’ll do

As a Data Engineer, you’ll perform the technical implementation of customer data platforms (CDPs) and serve as a key player as it relates to data management. Your responsibilities will include:

  • Interface with clients to gather requirements, map solutions, and make recommendations
  • Lead customer project conference calls or interfaces with the project manager
  • Create technical specifications to drive the development of the solution
  • Deliver technical specifications documents for customer review
  • Design custom development solutions that meet customer requirements
  • Progress through full development lifecycle for a custom solution
  • Deploy new solutions to production environments
  • Maintain and support new and existing solutions and frameworks
  • Innovate on new ideas to solve customer needs and assist to market internally new solutions
  • Provide project estimates and timelines to drive new business
  • Partnership and collaboration with sales and other internal teams
  • Teaming with engagement managers to communicate project status, risk and issues to clients as appropriate
  • Engaging cloud solution engineers and other domain-specific SMEs (Adobe, Salesforce, Oracle, Google and similar) to support platform implementation as needed
  • Coordinating Testing/SIT/UAT activities as required by project scope and team structure

Qualifications (required):

  • 3+ years experience in ETL development using Big Data Technologies
  • 3+ years experience in building large-scale data processing projects using cloud technologies
  • 3+ years experience with data modeling and tuning of relational as well as NoSQL datastores
  • Experience with Programming and Scripting Languages (.NET, Python, Powershell, Java, Batch, Bash and similar)
  • Industry experience as a data engineer or related specialty (software engineer, application developer)
  • Experience building/operating highly scalable, fault-tolerant, distributed systems for extraction, ingestion, and processing of large data sets
  • Experience with software engineering best practices, including but not limited to version control, CICD, automated unit testing
  • Experience using cloud-native tools and design patterns
  • Degree in computer science, engineering, or relevant industry experience
  • Excellent interpersonal skills and the ability to articulate complex technical concepts with technical and non-technical individuals
  • Ability to approach a technical solution to solve for challenges from a business perspective
  • Understanding and experience working with customer-centric data and how to define uses for this data to enable business goals
  • Understanding of the full SDLC process
  • Limited immigration sponsorship may be available

Preferences:

  • Experience and knowledge with marketing cloud solutions
  • Experience and knowledge with web analytics or digital marketing
  • Experience working with public cloud offerings (AWS, Azure, Google Cloud Platform, and similar)
  • GCP - (Cloud Functions, Composer, SQL, Storage, Dataproc, Datastore, Kubernetes, Big Query, Stackdriver, Pub/Sub)
  • AWS – (Lambda, Glue, Data Pipeline, Redshift, Aurora, Athena/Spectrum, S3/Glacier, Fargate, Cloud Watch, Kinesis)
  • Azure - (Functions, Batch, Blob Storage, Data Warehouse, Data Factory, Containers, Monitor, Service Bus)
  • Experience and knowledge with data science, ML/AI, R, or Jupyter
  • Experience and knowledge with customer data platforms or demand-side platforms
  • Experience as an enterprise technical or engineer consultant
  • Experience using C#, Java or Python
  • Experience with Martech/Adtech tools and how to integrate technologies into the data management solution. (Adobe, Salesforce, Oracle, Google, and similar)