Senior Data Engineer

Job Description

Project Description:
Our Company has contract with a major Telecommunications provider to engage to establish integrated cloud technology platforms to ingest information from various Network Engineering support applications in order to better optimize management and planning for the future network. To do this Network Engineering Ops is managing data ingestion into a Snowflake Azure based deployment which allows for one cohesive platform to serve all types of users and workloads in a consistent way. Centralizing data in a unified, governed, managed data platform allows all authorized users to access accurate and timely data for analysis that is useful for highly transnational datasets. It is also useful that it can store structured and unstructured data. Additionally Network Eng. & Ops is leveraging a Palantir platform for the creation and management of cost forecasting scenarios.

Responsibilities:
* Data Ingest Data Quality Management and Support
* Team to ingest data from/to Snowflake, On Prem, or Azure to Palantir and perform necessary data grooming and ongoing flow support to ensure informational requirements.
* Generally following monthly sprints but needs may shift depending upon parking lot prioritizations or cross-team integration planning.
* Team will also monitor data quality and resolve any issues related to data health.

Mandatory Skills Description:
* Data Engineering
* Palantir Foundry
* Cloud
* Big Data
* SnowFlake
* Python
* Databricks
* Azure

Nice-to-Have Skills:
* Palantir AIP