Data Integration Specialist

at Apex Systems Inc

location Bartlesville, Oklahoma

Updated on Aug 14, 2019

Contract Position
6 month(s)

  • Referral Bonus

    $500

    approx.
  • Signing Bonus

    $500

    approx.

Pay Rate $35.00 per hour

Experience 3-7 Years

Eligibility H-1B visa, Green Card, US citizen

Industry

Information Technology Services

Travel

Not Specified

Job ID

PATDC667318

Working Remotely Allowed

No

JOB DESCRIPTION

General Information/Assignment Scope:
An ideal candidate would have implemented a S3, Glue based data lake on AWS to aid data science work through sagemaker, Jupyter notebooks etc. He/she would have written ETL data pipeline using python or a 3rd party tool to bring data into S3 from on-premise and transformed it into analytics friendly format like Parquet, Orc or Avro.
Modeled data on S3 (partitions, bucketing) etc for optimizing queries. Provided SQL interface to the data on S3 using Athena or Presto service. Is familiar with Hive, Hbase, DynamoDB, ElasticSearch and other big data tools available on AWS. Has supported data science team by providing data from the lake and on-premise systems and provisioning EMR clusters for training and hosting models. An ideal candidate must also understand IAM security roles.
Hope that is a good summary but we may not find a candidate that has done all that. You may find people who have done this on Hadoop and have started delving into AWS or may find folks who have started with AWS and have done some of these things.
We will be interested to talk to these people. The requisition contains a list of technologies to look for on the resume.

"Description:
* Set up data lakes in AWS along with the services required to both transform the data and make it available to consumers.
* Deliver systems that are enterprise grade. This means addressing aspects such as security, scalability, and maintainability. Position requires experience building data warehouse environments.
The position requires good grasp of data transformation and data lake concepts on AWS cloud.

Specific language and technologies:
**candidate(s) do not need to have all of these skills; however, they are on the manager's wish-list
* Python language.* AWS Lambda.* AWS Glue.* AWS Athena.* AWS S3.* AWS Kinesis* Strong SQL skill.* Apache Presto * Hadoop or EMR experience* Cluster computing with PySpark.* Apache Ni-Fi.Required and Preferred Skills and Experience* Senior level, typically 7+ years of experience.* Understands advanced aspects of discipline and is viewed as an expert in a given field.* Applies broad range of competencies to develop solutions to complex problems.* Influences others to achieve objectives.* Often provides specialized/technical/functional guidance to others within department and/or business asset.

Similar Jobs

BRILLIANT FEATURES

Earn money by referring your friends to their next dream job, or find a job for yourself and the Referral Bonus becomes a Signing Bonus. Full time or Contract.

  • Make Money

    We’ll give you between several hundred and several thousand dollars for every successful referral.

  • Help Your
    Friends

    Job applications with personal recommendations are twice as likely to get hired.

  • 100% Free

    Absolutely zero sign up and subscription fees. We want to pay YOU!

  • Signing Bonuses

    All jobs on iEndorseU come with a Signing Bonus if you find a job for yourself

  • No credit card needed

    We pay you directly through Paypal, so keep your personal information…personal.

  • Sponsor others

    Get others to download our app and we will pay you $100 whenever they next get a job through our platform.

All the ways to make money from us