Innovating with the Public Sector: Reflections on Wadhwani AI’s Partnerships with the Government

For Wadhwani AI, it is important to engage with both the central and state governments through the entire life-cycle of our solution development and deployment process.
For Wadhwani AI, it is important to engage with both the central and state governments through the entire life-cycle of our solution development and deployment process.

“If I was given one hour to save the planet, I would spend 59 minutes defining the problem and 1 minute resolving it.” — Albert Einstein

At Wadhwani AI, we practice an integrated and multidisciplinary approach to problem-solving, where expertise in each area is woven into a common tapestry. We use this metaphor primarily to describe the way we work internally — from domain experts who understand complex issues in their fields, to designers and user experience researchers who dream up systems and processes, to AI/ML scientists and engineers who build the actual models and solutions. However, it is also a description of our approach to working with partner organisations, most significant of which are our government partners. With them, we roll-up our sleeves to identify and analyse problems for which we then build AI-powered solutions to create as large an impact as we can.

A problem-solving mindset

Wadhwani AI occupies a niche position in the nonprofit sector in India. We are a group of committed innovators building solutions for social impact, in close coordination with the social innovation ecosystem, including the last-mile user. For organisations like ours, working with the public sector from the very beginning helps to approach potential solutions from the lens of problem-identification rather than creating a tool and then looking for a problem to solve with it.

In applied problem-solving, the challenge lies largely outside the laboratory. To observe, analyse, solve, and scale, we must first come to terms with the fact that our work exists within a social, economic, and political context. For our work to reach the people we set out to help, we work alongside various stakeholders at the national and regional levels, and align to the long-term policies and vision of the government.

For the highly specialised work we do, the government is our most important partner and stakeholder.

Expecting challenges

For the highly specialised work we do, the government is our most important partner and stakeholder. Various government departments at the national and regional levels have the intent, scale, and existing structures for the development and deployment of AI-based solutions. They help us identify the right problems to solve and offer us platforms through which to scale our solutions so that we may impact millions of citizens.  

This requires that we embrace any short-term limitations that we may encounter. The scaffolding that we will find within public sector systems and programs does not need to be perfect to help us truly make an impact. Government bodies are often wrestling with multiple problems in the here and now, and we must create well-designed and enduring ways of socialising the benefits of using AI that are aligned to their goals.

From the government’s point of view, what makes us ideal partners is that we are a nonprofit seeking to create as large an impact as we can. The trust and responsibility that we receive from our partners is something we do not take for granted.

At Wadhwani AI, we practice an integrated and multidisciplinary approach to problem-solving, where expertise in each area is woven into a common tapestry.

Preparing the public sector for AI solutions

Our focus as an organisation is to build AI solutions that can create impact at scale, and also help enable and empower the public sector to use AI/ML effectively to enhance their programs and operations. At its essence, our work revolves around:

Problem identification: A team of cross-functional experts from our team work out of government offices. We work with the government to jointly identify problems, and then shortlist use cases based on feasibility and desirability from the perspective of all stakeholders. After mapping IT platforms, datasets, workflows, and operations to define the problem, we develop a solution roadmap.

Solution development: Once these use cases are shortlisted, we roll out proofs-of-concept within 90–120 days. Based on early deployment performance and acceptance by all stakeholders, we then deploy the solutions at scale.

Having skin in the game

The importance we accord to government partnerships is reflected in the AI Units and Centers of Excellence that we have set up within government ministries. Having our teams on the ground and inside public sector offices, interacting with beneficiaries, partners, donors, and other stakeholders is very critical. Equally important for us is to not just display, but also fulfil our intent. This is why we have set up AI Units within various government ministries, staffed with domain experts, AI/ML scientists, business analysts, and solution managers, among others. We are completely changing the methodology of how technology solutions are built in a public-sector setting, from the inside out.  

Our teams at our AI Units at the Central TB Division (CTD), Ministry of Health and Family Welfare, and Ministry of Agriculture and Farmers Welfare have, in a very short period, identified multiple use cases, developed proofs-of-concepts, and deployed a few solutions. With over 15 solutions at different stages of development and deployment, we can claim that this model of engagement is seeing early success. However, there are immense challenges ahead, and we will not be complacent.

We always welcome opportunities to educate our partners on AI and ML through workshops and accessible primers on AI methodology and core concepts.

Demystifying AI and managing expectations

It is our task to demystify AI and be transparent about what it can and cannot do. Jargon and a disproportionate focus on technical aspects of the technology or our solution will only detract from other aspects of problem-solving that form a more fundamental part of a large-scale project effort. This is why we always welcome opportunities to educate our partners on AI and ML through workshops and accessible primers on AI methodology and core concepts. We take the time to ensure that our partners understand the implications of using AI to solve a complex problem. We provide them with necessary and sufficient knowledge to make policy and operational decisions without having to rely on jargon. 

All players in the emerging technology space partnering with the government must manage the expectations of timelines, problem-solving, levels of possible automation, and impact. One way to accomplish this is to keep looking for areas where AI can be used quickly so that a delivered solution can be used as a learning ground, where all parties have traversed the path together. Such an approach can then be used to reflect on what worked and what did not, which is an integral part of the work we do at Wadhwani AI.

As we aspire to greater performance gains in accuracy and other metrics, we must continue to attend to explainability and trust. Discussing the vulnerability of the approach and solution with partners is an important first step. All AI systems will have a residual error rate which must be attended to as a potentially fatal flaw that requires careful consideration and design to overcome, instead of as a mere aberration or limitation of the system. Users and decision-makers must design the entire system to ensure that such situations are overcome with a human in the loop, process changes, regulatory controls, or system design metaphors. 

Laying the groundwork for future government partnerships

For Wadhwani AI, it is important to engage with both the central and state governments through the entire life-cycle of our solution development and deployment process. For each ministry and state we work with, we work closely with decision-makers who are fully focused on execution. We are also cognisant that it is important to build partnerships that are impervious to personnel change or political upheaval. Working closely with relevant personnel across the board in government organisations is critical to building a trust-based relationship with them, and is a necessary aspect of successful scaled deployment. We also actively seek feedback and strive to incorporate it through the rank and file of the institute.

It is our mission to ensure that our innovations are truly adopted at scale, and to socialise AI so that all ecosystem partners are ready for defining and solving problems using this promising technology.

Our innovations can be scaled faster and more efficiently by our partners in the public sector. Wadhwani AI’s mission is steadfast and clear — to ensure that our innovations are truly adopted at scale, and to socialise AI so that all ecosystem partners are ready for defining and solving problems using this promising technology. This way, we fulfil our mission of creating as large an impact as we possibly can, to reach the poorest of the poor across the globe. 

Additional contributors to this article include Shekar Sivasubramanian and Srividya Tadepalli. Infographic by Sharath Ravishankar.

ML Engineer

ROLES AND RESPONSIBILITIES

An ML Engineer at Wadhwani AI will be responsible for building robust machine learning solutions to problems of societal importance; usually under the guidance of senior ML scientists, and in collaboration with dedicated software engineers. To our partners, a Wadhwani AI solution is generally a decision making tool that requires some piece of data to engage. It will be your responsibility to ensure that the information provided using that piece of data is sound. This not only requires robust learned models, but pipelines over which those models can be built, tweaked, tested, and monitored. The following subsections provide details from the perspective of solution design:

Early stage of proof of concept (PoC)

  • Setup and structure code bases that support an interactive ML experimentation process, as well as quick initial deployments
  • Develop and maintain toolsets and processes for ensuring the reproducibility of results
  • Code reviews with other technical team members at various stages of the PoC
  • Develop, extend, adopt a reliable, colab-like environment for ML

Late PoC

This is early to mid-stage of AI product development

  • Develop ETL pipelines. These can also be shared and/or owned by data engineers
  • Setup and maintain feature stores, databases, and data catalogs. Ensuring data veracity and lineage of on-demand pulls
  • Develop and support model health metrics

Post PoC

Responsibilities during production deployment

  • Develop and support A/B testing. Setup continuous integration and development (CI/CD) processes and pipelines for models
  • Develop and support continuous model monitoring
  • Define and publish service-level agreements (SLAs) for model serving. Such agreements include model latency, throughput, and reliability
  • L1/L2/L3 support for model debugging
  • Develop and support model serving environments
  • Model compression and distillation

We realize this list is broad and extensive. While the ideal candidate has some exposure to each of these topics, we also envision great candidates being experts at some subset. If either of those cases happens to be you, please apply.

DESIRED QUALIFICATIONS

Master’s degree or above in a STEM field. Several years of experience getting their hands dirty applying their craft.

Programming

  • Expert level Python programmer
  • Hands-on experience with Python libraries
    • Popular neural network libraries
    • Popular data science libraries (Pandas, numpy)
  • Knowledge of systems-level programming. Under the hood knowledge of C or C++
  • Experience and knowledge of various tools that fit into the model building pipeline. There are several – you should be able to speak to the pluses and minuses of a variety of tools given some challenge within the ML development pipeline
  • Database concepts; SQL
  • Experience with cloud platforms is a plus
mle

ML Scientist

ROLES AND RESPONSIBILITIES

As an ML Scientist at Wadhwani AI, you will be responsible for building robust machine learning solutions to problems of societal importance, usually under the guidance of senior ML scientists. You will participate in translating a problem in the social sector to a well-defined AI problem, in the development and execution of algorithms and solutions to the problem, in the successful and scaled deployment of the AI solution, and in defining appropriate metrics to evaluate the effectiveness of the deployed solution.

In order to apply machine learning for social good, you will need to understand user challenges and their context, curate and transform data, train and validate models, run simulations, and broadly derive insights from data. In doing so, you will work in cross-functional teams spanning ML modeling, engineering, product, and domain experts. You will also interface with social sector organizations as appropriate.  

REQUIREMENTS

Associate ML scientists will have a strong academic background in a quantitative field (see below) at the Bachelor’s or Master’s level, with project experience in applied machine learning. They will possess demonstrable skills in coding, data mining and analysis, and building and implementing ML or statistical models. Where needed, they will have to learn and adapt to the requirements imposed by real-life, scaled deployments. 

Candidates should have excellent communication skills and a willingness to adapt to the challenges of doing applied work for social good. 

DESIRED QUALIFICATIONS

  • B.Tech./B.E./B.S./M.Tech./M.E./M.S./M.Sc. or equivalent in Computer Science, Electrical Engineering, Statistics, Applied Mathematics, Physics, Economics, or a relevant quantitative field. Work experience beyond the terminal degree will determine the appropriate seniority level.
  • Solid software engineering skills across one or multiple languages including Python, C++, Java.
  • Interest in applying software engineering practices to ML projects.
  • Track record of project work in applied machine learning. Experience in applying AI models to concrete real-world problems is a plus.
  • Strong verbal and written communication skills in English.
mls