Posted in Jobs 101

Senior Data Platform Engineer, Contractor – Pennsylvania

   Published Date: November 23, 2021

[ad_1]

POSITION SUMMARY

The Senior Data Platform Engineer will work 100% in the Microsoft Azure cloud to build, operate, and enhance a lean, efficient, and powerful data platform that identifies new pharmaceuticals expected to enter the global market within the next 2.5 years, and track them until market entry has been achieved.

The Senior Data Platform Engineer will use Python, Azure DataBricks, Azure Data Factory, and https://scrapy.org to automate ingestion of publicly available information via RSS feeds, scraping, and API calls that are persisted to multiple types and tiers of Azure storage. The Senior Data Engineer will support the processing, aggregation, and reshaping of the data to enable analytics and ML work conducted by ECRI Data Scientists and Specialists. Curated and processed data will be distributed by API’s to a public facing website as well as used internally by ECRI researchers developing reports to highlight pharmaceuticals with high potential to cause a significant impact to one or more areas of healthcare in certain countries. Reports will include healthcare use, infrastructure, service delivery, disease management, patient health outcomes, and healthcare costs.

In addition the system will support regular and frequent human curation, review and feedback to ensure all records in the system are up to date and of high quality.

The Senior Data Platform Engineer will work closely with ECRI product development, enterprise architecture, and business experts to continually review, improve, and refine the ingestion of data from harvested trials, news releases & reports, and other sources being captured on a daily basis.

This system must be of high quality, excellent performance and optimal costs to operate month to month. Therefore a thorough understanding of Azure pricing models and which services are best for which use cases is critical.

The Senior Data Platform Engineer is a contractor role, expected to last for four months.


ESSENTIAL FUNCTIONS


Reasonable Accommodations Statement

To accomplish this job successfully, an individual must be able to perform, with or without reasonable accommodation, each essential function satisfactorily. Reasonable accommodations may be made to help enable qualified individuals with disabilities to perform the essential functions.

Essential Functions Statements(s)

  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Assist in gathering and document business requirements.
  • Support and work with cross-functional teams.
  • Participate in team meetings and code reviews.
  • Work independently and within a team when needed.


QUALIFICATIONS

  • 3-5 years using Python is critical
  • Comprehensive hands on experience and knowledge of the following Microsoft Azure product areas:

    • Azure DataBricks, Notebooks and Spark
    • Azure Blob Storage
    • Azure SQL
    • Analytics
    • Storage and the financial and technical pros/cons of the many options
    • Functions
    • Networking
  • 3-5 years hands on experience in at least three modern languages and frameworks such as: Python, C#, Node.JS, .NET Core, Swift, Kotlin.
  • Experience with relational SQL and NoSQL databases, such as SQL Server, PostgreSQL and Cassandra.
  • Experience with agile methodologies, especially Kanban, and using tools like Jira and Confluence to facilitate the work.


Additional Beneficial Skills (Not Required):

  • Familiarity with DevOps technologies.
  • Familiarity with CI/CD pipelines.
  • Healthcare business experience.
  • Natural Language Processing (NLP)

Experience:

  • Associate/Bachelor’s degree in Computer Science, or related major.
  • Equivalent professional experience will be considered in lieu of degree.


PHYSICAL DEMANDS

N (Not Applicable)

Activity is not applicable to this position.

O (Occasionally)

Position requires this activity up to 33% of the time (0 – 2.5+ hrs/day)

F (Frequently)

Position requires this activity from 33% – 66% of the time (2.5 – 5.5+ hrs/day)

C (Constantly)

Position requires this activity more than 66% of the time (5.5+ hrs/day)

Physical Demands

Manually Manipulate

C 21-50 lbs N

Reach Outward

O Over 100 lbs N

Squat or Kneel

N 26-40 lbs N


Other Physical Requirements


WORK ENVIRONMENT

Typical Office Environment

#LI-Remote


Equal Opportunity Employer-Disability and Veteran

[ad_2]

Source link

Author: admin