Highlights
They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools. The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company’s objectives.
Numbers & Facts
| Location | Charlotte, NC |
| Industry | Staffing/Employment Agencies |
| Salary | $70–$75 Per Hour |
| Company Size | 2,000 to 2,499 employees |
| Year Founded | 2000 |
| Website | http://www.lancesoft.com/ |
Description
Job Title: Data Engineer
Location: Charlotte, NC
Job Description:
The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company’s objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools.
Skills and Knowledge:
•Developer experience specifically focusing on Data Engineering.
•Hands-on experience in Development using Python and Pyspark as an ETL tool.
•Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
•Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
•Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
•Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
•Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL.
•Experience with data models, data mining, data analysis and data profiling.
•Experience in working with REST API's.
•Experience in workload automation tools like Control-M, Autosys etc.
•Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins.
•Strong experience with Agile/SCRUM methodology.
•Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.).
•Knowledge in MDM, Data warehouse and Data Analytics.
Location: Charlotte, NC
Job Description:
The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company’s objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools.
Skills and Knowledge:
•Developer experience specifically focusing on Data Engineering.
•Hands-on experience in Development using Python and Pyspark as an ETL tool.
•Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
•Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
•Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
•Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
•Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL.
•Experience with data models, data mining, data analysis and data profiling.
•Experience in working with REST API's.
•Experience in workload automation tools like Control-M, Autosys etc.
•Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins.
•Strong experience with Agile/SCRUM methodology.
•Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.).
•Knowledge in MDM, Data warehouse and Data Analytics.
About Company
We are a $125 Million, NMSDC-certified Minority & Woman owned Workforce Solutions Company headquartered in the DC metro area with presence across US with global presence - Canada, Mexico, India, UK, Malaysia, Indonasia, Hongkong, Singapore, UAE. We are specialized in providing Workforce Solutions, SOW project delivery, Engineering Solutions, Creative Services. We currently support 100+ Fortune companies globally and across multiple industry segments. We are currently supporting several massive programs across industry segment nationally/globally (Intel, Ally, AMD, QUALCOMM, Morgan Stanley, Kraft/ Mondelez, MNP, Amdocs, Dell, SanDisk, Medtronic, Becton Dickinson, GE, Lockheed Martin, UTC, L-3 Communications, Caterpillar, BMW, Mercedes Benz, National Grid, Dominion, Energy Future Holdings, PSEG, 3M, Fidelity, Aetna, Humana, Johnson & Johnson, Pfizer, Merck etc).
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender, identity, national origin, disability, or protected veteran status.