🎙️#19: VP of Data Science - Shabaz Patel @ One Concern

December 12, 2023

original link: https://thegoodaipod.substack.com/p/19-vp-of-data-science-shabaz-patel

Climate AI and the GenAI Wave

Dec 12, 2023

Happy Monday!!! We’re back with another episode of the Good AI podcast - this time we sat down with a friend of mine and previous co-founder, Shabaz Patel who currently leads the Data Science team at [One Concern](https://oneconcern.com) to discuss the meaning of Good AI for Climate! The timing of this post happens to coincide perfectly with NeurIPS 2023, one of the biggest ML conferences in the year and a time where the top ML researchers and thought leaders meet to present their research, learn from each other and decide what to work on next.

In this podcast, we’re chatting with one of those researchers,

Shabaz Patel

, who is driving novel climate analytics that build resilience for communities and enable creation of infrastructure to make businesses and economic systems resilient to natural disasters. While climate tech certainly fits the Good AI bill, we explored a bit further into what Good AI really means and what technologists can do to mitigate the effects of bad actors when releasing new tech. As always, check out the video below, short clips on Instagram or TikTok or listen on your favorite podcast platform.

ML Stack at

One Concern

[ 0:25 ] The Technical Stack at One Concern is all based on Google Cloud.

• Data Sets (public and private): stored via semantic versioning in GCS buckets.

• Models: Jupyter notebooks within K8s (GKE) to build and experiment with models

• Continual Data Pipelines: Argo is used to manage workflows

• CI / CD : cloud-based CircleCI

• Monitoring Data Stream: Great Expectations to monitor data quality

  • Data Scientists will review any anomalies

• Data Storage: Postgres for static DB Snowflake enables easy data manipulation

[ 7:25 ] What ML Models do you use and where they are used throughout the stack?

• Data Imputation and Cleanup

  • Semi-supervised techniques to generate attributes of the building (e.g. building types, construction material, etc.)

  • Network based models to generate power network graphs which represent the grid and are useful inputs to business downtime models.

  • ViTs for object detection via satellite and google maps imagery to fill in the details of building features and nodes in a network.

• End-Customer ML Models

  • Physics+ML models to calculate the damage to buildings and propagating that effect to calculate business downtime from natural disasters.

[ 13:10 ] How does One Concern contribute to creating a better world - Good AI?

• The incidence of natural disasters is increasing every day, and risk is continuing to increase. Hence, climate change is top of mind for all businesses

• Disclosures are also being enforced by governments and consortiums forcing a shift to renewable sources of energy.

• One Concern quantifies the risk profile associated with a changing climate and increased natural disaster risk, which forces companies to shift toward renewable and reliable sources of energy (e.g. power backups) so they can build a more sustainable business and reduce their overall risk profile.

[ 19:20 ] Can you give an example of precision mitigation that businesses might take after using One Concern?

• Dunkin’ Donuts in Miami have $2M to invest and they want to identify the highest ROI location to invest in precision mitigation over the next 10-20 years depending on their time horizon. One Concern quantifies the reduced value at risk from adding mitigations like metal shutters or flood bags to locations to make more granular investment decisions.

AI Risks

[ 21:20 ] What are the risks with this AI technology? Is there a way mitigate these risks?

• Bad actors are always a danger for any new technology - One Concern identifies vulnerabilities in the system which could be used to exploit those most in need.

• Mitigating the bad uses of technology are possible but incentives aren’t always there - government can play a role in setting rules around the technology.

  • Will regulatory capture only benefit the large companies who lobby for their businesses? This is not clear, which is why a balance between government and private consortiums.

• Good practices and guidelines are as important as the outcomes of the model. Having a balance of both process and outcomes regulation is more practical.

AI Regulation

[ 27:20 ] Regulated use case example: PaLM-Med is a language model focused on answering medical questions from patients or doctors.

• Model is limited even though it can perform well on the USMLE exams and requires a human in the loop to mitigate its worst effects

• Regulation for high stakes use case is critical because medical models, self-driving models and other scenarios have their own nuances.

• Industry consortiums are another way to ensure adherence to good practices and in many ways can be more effective since peers are working together rather than adversarially as with most government regulation.

[ 32:00 ] AGI and what it means for us today - are we really doomed or are there more benefits to be had with narrow models?

• Within the ML space, there are still disagreements on whether our current architectures can get us to AGI or whether we have already achieved it in some ways via agents.

Advice for the Audience who want to make an impact

[ 34:10 ] What is your advice for an audience that’s interested in doing something positive in the AI space? What do you wish you would have known 5 or 10 years ago?

• Model evolutions are hard to predict - but we have predictability over the 1-2 years. Invest in those techniques today and finding a burning customer need that they can solve.

• Thinking about the next 5-6 years is good but only a small portion of folks need to do that and it is a high risk endeavor. Customer needs today abound leaving many more opportunities for success. Technologies can always be replaced.

AI + Climate Opportunities on the Horizon

[ 38:10 ] What are the opportunities for AI technologies for Climate and more broadly?

• Political refugees are currently a big challenge, but climate-based refugees are a problem not too far on the horizon due to displacement from areas on the globe that will become uninhabitable in the near future. Identifying and addressing this challenge can help prevent a crisis in the future.

  • Examples: predict this and address it early, if preventable, identify scientific advancements to slow down this process, AI can help in both of these scenarios.

Hope you enjoyed this episode! If you’re interested in listening to the pod subscribe on Spotify, Apple Podcasts or if you want to watch subscribe on Youtube!

✌🏽Anand