Data Warehouse Engineer

Promoted provides ranking-as-a-service to marketplaces and e-commerce apps. We built our own streaming analytics system to join and aggregate user events to power recommendations that are real-time reactive within the same session.

We've implemented a simple v1 data warehouse that relies heavily on S3, Kafka, and Athena. We are hiring an engineering expert to build a more advanced data warehouse system using existing data warehouse technologies. You should be an expert in at least one of and have informed opinions about all of:

• Redshift
• Druid
• Pinot
• Clickhouse

You should also know about:

• Federated queries
• Data lineage
• Machine efficiency optimization
• Schema catalogs and how to handle complex schemas
• Experience exposing data warehouses externally

Experience with real-time systems designed for low latency is required.

We are a team of ex-Google and Facebook ads engineers. The ideal candidate will have experience working at one of these companies in discovery, search, feed, or ads ranking or other real-time delivery systems that apply machine learning at scale. An ideal candidate would be on an ML data infrastructure team supporting these departments.

Remote and non-US is OK. We are currently fully remote, but we will have an office in San Francisco after COVID.

Part-time consulting is OK for experienced engineers who are data warehouse experts