Senior Data Engineer

Company Overview:

Terrace is a riskless-principal brokerage and software platform for digital assets. We offer better pricing, deeper liquidity, and broader asset coverage than any digital asset broker or exchange. Terrace is self-custodial and provides cross-chain and DeFi/CeFi hybrid order, execution, and portfolio management on over 40 DEX, CEX, market makers, and OTC desks.

Job Description:

We seek a highly skilled and self-motivated Senior Data Engineer with expertise in building data lakes and experience working with blockchain data. Your primary focus will be to build a data lake that ingests and processes data streamed from blockchain nodes. Proficiency in storing, warehousing, and querying large volumes of data in formats like Parquet files is essential.

Key Responsibilities:

• Design and implement a scalable data lake architecture to ingest, store, and process large volumes of blockchain data streamed from nodes.
• Develop efficient data ingestion pipelines to capture and store data from various blockchain networks in a unified data lake.
• Implement a cost-effective storage and warehousing solution for Parquet files, ensuring fast query performance and scalability.
• Leverage tools like DuckDB and Polar.rs to optimize query performance and enable efficient analysis of blockchain data.
• Collaborate with cross-functional teams to understand data requirements and deliver tailored data solutions that support business objectives.
• Apply best practices in data management, security, and governance to ensure data integrity, privacy, and regulatory compliance.
• Continuously optimize and scale the data lake infrastructure to handle increasing data volumes and evolving business needs.
• Provide technical leadership and mentor junior data engineers, fostering a culture of innovation and excellence.

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 7+ years of experience in data engineering, with a strong focus on building and managing-large-scale data lakes.
• Proven experience working with blockchain data and a deep understanding of blockchain architectures and protocols.
• Expertise in designing and implementing data ingestion pipelines for real-time and batch data streams from blockchain nodes.
• Proficiency in storing, warehousing, and querying large volumes of data in formats like Parquet files.
• Experience with tools such as DuckDB and Polar.rs for optimizing query performance on large datasets.
• Strong programming skills in languages such as Go, Node.js, and SQL.
• Experience running and managing blockchain nodes is a significant advantage.
• Excellent problem-solving, analytical, and communication skills, with the ability to work collaboratively in a fast-paced environment.

Technologies We Use:

• Programming Languages: Go, Node
• Kubernetes, GCP, Terraform
• Data Tools: DuckDB, Polar.rs

Additional Information

We’re working to build a more inclusive and decentralized economy where we all have equal access to opportunity, and we strive to live by these same values in building our workplace. Terrace is a proud equal opportunity employer. We work hard to evaluate all employees and job applicants consistently without regard to race, color, religion, gender, national origin, age, disability, pregnancy, gender expression or identity, sexual orientation, citizenship, or any other legally protected class.

We believe in fairness and are committed to an inclusive interview experience, including providing reasonable accommodations to disabled applicants throughout the recruitment process. We encourage applicants to share any needed accommodations with their rruiter, who will treat these quests as confidentially as possible.