Senior Software Engineer, Data Infrastructure

‍

Description

At Arcus, our mission is to advance AI through better data. We believe that data is the ultimate representation of the world and providing ML models with the highest fidelity representations is the most important challenge to solve for AI today. We’re advancing the state of the art in AI by ensuring that every model has the data it needs.

We’re building the comprehensive data platform that enables enterprises to build intelligent AI applications on their structured and unstructured data. From “chat over your data” to multi-modal, reasoning applications – Arcus scales to the complexity of any intelligent AI application. Arcus manages the data workflows needed to make large-scale, complex data useful for LLMs – from ingesting and indexing the data to providing retrieval and evaluation capabilities – Arcus supports even the most complex AI applications.

We’re extremely well-funded and backed by top tier VCs and angel investors who share our mission and we’re based out of our Flatiron office in NYC.

‍

What You'll Do

As a Senior Data Infrastructure Engineer at Arcus, you will be responsible for building the core distributed systems which power the Arcus data platform and the infrastructure for our ML systems. You will work across the engineering team and with our customers to build the core infrastructure that scales to ingest, index and retrieve over planet-scale data volumes and run our internal model training and serving systems.

We use technologies like Golang, Python, gRPC, TorchServe, Docker and Kubernetes. 

‍

‍Key Responsibilities

• Build scalable and reliable infrastructure for storing, indexing, querying, and serving the data that powers our data platform.
• Architect our distributed systems that process and transform data in highly performant, low-latency environments.
• Ensure that our systems are scalable and reliable to enrich LLMs applications with large volumes of data in real-time.
• Work closely with customers to support their critical workloads and drive the future direction of the platform.
• Define the future and culture of Arcus with your initiative and feedback.

‍

Who You Are

• Have experience building distributed systems that process large volumes of data.
• Excited to juggle multiple hats and work cross-functionally based on the needs of the business.
• Bias towards shipping rapidly and iterating with customer feedback.
• You have a demonstrated track record of excellence, across any field or domain (not necessarily related to the role).
• Exhibit a strong passion for taking ownership, continuous learning and personal growth.