Data Engineer (Secret Clearance)

at Alan N. Daum And Associates
Location New York, New York
Date Posted July 31, 2022
Category Engineering
Job Type Not Specified


Data Engineer

Locations: Manhattan, NY, DC, Virginia

Job Description

  • Serves as Data Engineer for Space Force s C2 DaaS (Warp Core) Team
  • Works in Integrated Products Teams to: Scope new data integrations o Design data models o Perform data cleansing and transformation within the Foundry platform.
  • Provides guidance and support for operators and external developers in: Accessing and leveraging the data foundation to create new workflows
  • Performs Data Engineering and Pipeline Maintenance o Setup transfers of data feeds from source systems into location accessible to
  • Foundry o Ingest new data sources using Foundry s data ingestion UIs o Debug issues related to delayed or missing data feeds o Write transformations and derive new datasets o Monitor build progress and debug problems o Using Spark for distributed computation

  • Designs and Develops Application/Workflow Configuration o Use Foundry s application development framework to design applications that address operational questions Rapid development and iteration cycles with users o Test and troubleshoots application issues o Investigate data questions surrounding applications
  • Works in and across teams, specifically with: Warp Core Program Management Team o Space C2 SMEs o Project Leads
  • Qualifications:

  • BS in Computer Science / Engineering (or related career field)
  • Proficiency with one or more programming languages such as: Python (Pyspark, Pandas - Familiar or willing to learn)SQLR or similar languages
  • 5+ years experience working with large scale data for business solutions Analytical mindset and eagerness to solve technical problems with: Data structures o Storage systems o Cloud infrastructure o Front-end frameworks, and other technical tools.
  • Experience with Gotham or Foundry (preferred)
  • Strong communication skills
  • Must take ownership and accountability of role/responsibility within team
  • Must pass Hackerrank screening
  • Clearance: Secret (Required)

    Job Type: Full-time

    Salary Range: $175,000 - $225,000

    Drop files here browse files ...