Data Engineer

Charlotte, NC

Company Name :IBA Infotech LLC

Type : Contract

Primary Skills : JSON, Restful API, SOAP WS, EDI

Location : Charlotte

CTC : DOE

Job Description:

Essential Functions:

  • Develop extract, transform, and load processes using Azure Data Factory, Databricks (PySpark and Spark SQL), and SQL (Azure SQL Data Warehouse)
  • Developing data load and transformation processes using integration tools such as Azure Logic Apps, Chiapas EDI, and MirthConnect.
  • Responsible for designing, developing, testing and troubleshooting SSAS Tabular Models
  • Strong knowledge with Microsoft SQL Server database fundamentals (SQL queries, stored procedures, indexes, triggers, functions)
  • Strong Knowledge of DAX
  • Knowledge of Power Query
  • Reviews and explores source data as it relates to business concepts as well as how it relates to other data elements
  • Translate business requirements into technical designs to map and load data from source systems to Cardinal Innovations Data Platform
  • Ensure quality and accuracy of the data mapped from staging environments to the target reporting environments
  • Provide support to existing ETL jobs
  • Develop ETL audits and controls to ensure the quality of data meets or exceeds defined standards and thresholds
  • Ability to perform simple-to-moderately complex tasks with minimal assistance
  • Maintaining data repository with data definitions, relationships, linkages and sources

 

Knowledge, Skills, and Abilities:

  • Knowledge of Kimball Star Schema database model
  • Knowledge of Azure Data Factory, Azure Databricks (PySpark and Spark SQL), Azure SQL Data Warehouse, Azure Analysis Services, and Microsoft Azure Logic Apps
  • Knowledge of Data Lake Architecture
  • Familiarity with PowerBI data models, DAX Studio, and Tabular Editor
  • 3-5 years of experience with Visual Studio
  • Self-driven with the desire to achieve measurable, specific results within tight time frames
  • 5+ years experience with Microsoft T-SQL
  • Knowledge of .Net / Scripting Languages (C#,VB.NET, Python, Powershell)
  • Familiarity with JSON, Restful API, SOAP WS, EDI
  • Understanding of API/Web services
  • Good problem solving, design, coding, and debugging skills
  • Quick learner
  • Excellent communication skills and strong presentation skills
  • Analytical, Problem solving, creative thinking and design skills
  • Ability to maintain a thorough understanding of the business

 

Required Education, Training and Experience:

  • Bachelor’s Degree in Computer Science, Computer Information Systems, and Information Technology
  • Experience with data modeling, data analysis, data profiling, and data mapping