Director of Engineering, Knowledge Platform

Dataminr

Dataminr

United States · Remote
Posted on Sep 18, 2024

See yourself at Dataminr

At Dataminr, we are creating a team of talented builders, creators and visionaries to have a real-world impact on how organizations respond to fast-emerging events as they unfold. We are over 600 talented individuals, spanning seven global offices, united by our passion to use AI for the greater good and be agents of positive change in our company and in our communities.

We offer a competitive benefits package aimed at keeping you healthy and happy:

  • Comprehensive medical, dental and vision insurance plan options for employees, domestic partners and their dependents

  • Generous PTO, flexible sick days and remote working options

  • Paid parental leave and family forming benefits

  • Mental health benefits and support

  • Company equity (RSUs)

At Dataminr, we serve a global community made up of many cultures and strive to reflect the diversity of the world in which we live. We stand for social justice and we lead with empathy. We foster a culture of allyship, standing up for those who face systemic barriers to equality. We actively condemn racism and discrimination in any form.

We believe our differences give us strength. Our employees are empowered to be their best, authentic selves through various opportunities, such as our robust employee resource group (ERG) network, learning and development funds, and more.

See yourself at Dataminr

We are looking for a Director of Engineering, Knowledge Platform (KP) to join our AI Organization. The Knowledge Platform team develops and is responsible for the KP, which includes the multi-million node entity Knowledge Graph (KG) that powers Dataminr's real-time event detection and alerting platform and enhances our users’ experience.

As Director of this team, you will set the technical and strategic direction of the KP Platform, working closely with other stakeholders across product and engineering to continue to exponentially scale our KG and related capabilities. You will have operational leadership of an interdisciplinary team of Engineers and Scientists, delivering features used in production 24/7 at major scale. You will have a product-focused mindset, strong engineering skills, and ideally, a solid understanding of research issues and practical solutions to problems in significantly scaling Knowledge Graphs. This should include balancing latency requirements, efficient data extraction, alignment, normalization, and ingestion, as well as leveraging and optimizing Human-in-the-Loop processes necessary in the construction and maintenance of large-scale Knowledge Graphs. You will also be aware of state-of-the-art methods that leverage LLMs for KG-related tasks. Additionally, you will use your expertise in scalable software architectures, cloud native development, and distributed systems to continue scaling a robust Knowledge Platform that enables Dataminr's mission of sending real-time alerts that save lives. This US-based role can be remote or based out of our New York City office.

The opportunity

  • Set strategic and technical leadership for everything related to the KP, managing a team of Engineers and Scientists.

  • Work with the team to design and develop pipelines and services for extracting, aligning, normalizing, and ingesting data into a knowledge graph.

  • Work to develop and apply AI-powered solutions that automate data quality assessments and data updates to the knowledge graph.

  • Develop tools and capabilities that simplify knowledge graph data access and management.

  • Work on AI-focused applications of the knowledge graph that enable essential capabilities like Named Entity Recognition (NER), Entity Linking (EL), and hallucination mitigation (GenAI/LLM).

What you bring

At Dataminr, we value you for who you are. We encourage you to apply for this role, even if you don’t meet every qualification. Our candidates are reviewed on the basis of their skill and potential to succeed.

  • M.S. in Computer science. Ph.D. studies in any field is a plus.

  • 10+ years of experience in software engineering, including significant experience with algorithms, data structures, and software design principles

  • Proficiency in programming languages used for data processing and AI, such as Python, Java, Scala, and C/C++

  • Solid understanding of core data engineering concepts and workflows including ETL pipelines, data cleansing and normalization, data enrichment, schema design, and data provenance.

  • Prior experience working with knowledge graphs is a plus.

  • Experience with cloud-native development and distributed systems.

  • Experience working with cross-functional teams.

  • Strong problem-solving skills.

About Dataminr

Dataminr is a mission-driven AI company that delivers real-time information from 1M+ public data sources, empowering organizations to respond to critical events and emerging risks before they unfold. Founded as an AI company in 2009, Dataminr has the history and tenure in artificial intelligence, and has developed pioneering technology that is redefining the future of real-time information. Recognized as one of the world’s leading AI businesses, recently, Dataminr launched ReGenAI, the first generative AI that automatically regenerates in real-time. Most recently valued at $4.1B, our technology is leveraged by more than two-thirds of the Fortune 50 and half of the Fortune 100 companies who all rely on our AI because we do something that others cannot do.

Watch our CEO Ted Bailey, discuss the Future of Real-Time Information, the breadth of customers who trust Dataminr, and our proprietary ReGenAI technology here.

At Dataminr, we are creating a team of talented builders, creators and visionaries to have a real-world impact on how organizations are able to respond to events. We operate all around the world united by our passion to use AI for the greater good, be agents of positive change and put our technology into the hands of client charged with the responsibility to keep organizations running and keep people safe.

Colorado, New York, California, Washington only: The salary range for this position is as indicated below. Base salary ranges may vary by geographic location, applicant skills, and prior relevant experience, among other factors.
Colorado: $157,500 - 166,500
New York/California/Washington: $170,000 - $185,000

Dataminr is an equal opportunity and affirmative action employer. Individuals seeking employment at Dataminr are considered without regards to race, sex, color, creed, religion, national origin, age, disability, genetics, marital status, pregnancy, unemployment status, sexual orientation, citizenship status or veteran status.