Sunday, November 8, 2026
HomeBig DataA Engineering Chief’s First 90 Days at Databricks

A Engineering Chief’s First 90 Days at Databricks

[ad_1]

I lately joined Databricks as Website Lead for the Seattle workplace and lead engineering for the Companion Platform crew. This profession transfer builds off of my 18+ years within the information and platforms house. I began my profession at Microsoft on the Excel crew and most lately was VP of Engineering & Product for the Knowledge Administration crew at Tableau. From engaged on pivot tables to visible information prep, I’ve loved serving to clients make higher selections by way of information.

So, why did I be part of Databricks? As we ramp up and increase our presence within the Seattle space, I spend plenty of time speaking to future Bricksters (candidates) – this is without doubt one of the questions I hear probably the most. The brief reply – Databricks has the fitting elements to really democratize information and AI. Databricks has a robust historical past of innovation and execution, has attracted prime expertise within the subject and has the client attain to appreciate this imaginative and prescient. There may be plenty of pleasure and optimistic momentum, so I assumed I’d clarify how I approached my choice to hitch Databricks and replicate on the expertise of my first 90 days right here.

Inspiring mission to simplify and democratize information

Databricks is on a mission to simplify and democratize information and AI, serving to information groups clear up the toughest enterprise information challenges. With the Databricks Lakehouse Platform, clients can unify all their information, analytics and AI workloads on one easy platform. That is so highly effective! In my brief time right here, I’ve realized about unbelievable buyer tales like Regeneron and Shell, and the affect these clients are having on the world is actually inspirational.

With Databricks, Regeneron has accelerated drug goal identification, growing general productiveness and getting new medicine out quicker and cheaper. If this pandemic has taught us something, it’s that fast medical innovation is important, so serving to firms like Regeneron course of information quicker can finally save lives. Shell is utilizing Databricks to assist ship progressive vitality options for a cleaner world. As a mother of two younger boys, defending the environment for future generations is so essential.

These buyer tales are usually not relegated to a selected business or sector. We now have the chance to assist clients throughout varied industries – from life sciences to non-profits, finance to know-how and every thing in between. Working at an organization the place you imagine within the mission and get to be a part of fixing a few of the bigger issues affecting society is inspiring and unifying.

Collaborative, humble-smart co-workers

Working to unravel difficult issues is far more enjoyable and efficient while you like who you’re employed with. This brings me to top-of-the-line components of Databricks: the folks! All of my colleagues and teammates are actually educated about their areas and captivated with our clients and the chance for affect. It’s been actually thrilling to work with prime expertise throughout our varied enterprise features. Our senior leaders actually care, lots of them are co-founders and have shepherded the corporate from its infancy to a interval of fast progress. Whether or not it’s my supervisor Reynold (one of many co-founders of Dataricks who’s the highest contributor to Apache Spark), Vinod our SVP of engineering, or my engineering friends together with:

  • Lei engineering chief for the visualization crew,
  • Michalis engineering chief for the question processing and storage crew,
  • Sridhar engineering chief for the SQL Gateway crew,
  • Arik founding father of Redash and architect
  • Shant architect for Databricks SQL

It is a proficient crew I take pleasure in working with and studying from day by day. I typically inform my colleagues and groups that I spend extra of my awake hours with my crew than my two children, so I wish to make certain I work with collaborative, pleasant, and sensible colleagues.

Tradition and velocity of innovation

An incredible mission, nice folks and a confirmed tradition of innovation is the key sauce to success. Databricks has a historical past of innovation. It was began by the founders of Apache Spark, however has not stopped there. The corporate is continually taking a look at methods to out innovate themselves. In a short while, the corporate has created MLflow, Delta Tables, Delta Sharing, Unity Catalog, Databricks SQL…the record goes on. Our groups are fixing onerous issues day by day. Whether or not it’s launching and monitoring hundreds of thousands of digital machines per day that course of exabytes of information or constructing person experiences to simplify the complexity of information science, there’s alternative right here to sink your enamel into fixing onerous technical issues throughout the software program stack.

Within the 90 days I’ve been right here, we launched the Seattle website, launched Companion Join, set the official information warehousing efficiency report, introduced GA of Databricks SQL and have been named a frontrunner within the Gartner Magic Quadrant for DBMS and DSML – making Databricks the one cloud-native vendor to realize this. Wow – it’s been so humbling to be a part of these unbelievable achievements. If that is what the primary 3 months appears like – am desirous to see what we accomplish as a crew in 2022!

In my time right here, I’ve additionally been impressed with our robust engineering tradition: nicely thought-through design docs, funding in dev tooling and productiveness, and powerful end-to-end possession throughout groups. In fact, quick progress doesn’t come with out rising pains. For example, our onboarding must always be revamped as a result of we’re rising so rapidly! What labored 6 months in the past doesn’t work for an engineering crew that has now greater than doubled in measurement. Even with an amazing doc tradition, there’s nonetheless tribal data, and it takes time to determine who is aware of what. There’s a lot alternative to be a part of rising the crew, the product and the tradition on this rocket ship.

We’re hiring!

And sure – we’re hiring =) Our Seattle website may be very strategic to our progress and we’ve got core efforts being developed out of Seattle. You possibly can learn extra in our weblog submit right here.

Regardless of the challenges of COVID, we’re creating an thrilling tradition. Earlier than the vacations, our Seattle Bricksters received collectively to construct gingerbread homes and loved boba with members of the senior management crew. Final month we had our first business networking occasion in Bellevue, internet hosting over 50 engineering leaders who received to study extra about Databricks from our CTO Matei and SVP of engineering Vinod. Databricks and our management is dedicated to rising our presence regionally.

I can’t wait to look again on this weblog submit of my first 90 days and see what else we’ll obtain down the highway!



[ad_2]

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular

Recent Comments