Scale By The Bay 2020: Prashant Sharma, Apache Spark meets FIPS standard
ai.bythebay.io Nov 2025, Oakland, full-stack AI conference As developer community in enterprise companies like, health care, finance, telcom, retail, and manufacturing, are considering Apache Spark for their data processing, they are also looking for solutions to harden their enterprise security, being FIPS compliant comes first to the mind (FIPS are the Federal Information Processing Standards). In principle, this talk can will help any java based application to meet FIPS compliance. Cloud HSM and Keep your own key, take enterprise security to another level. For example, why do some enterprises prefer to build their own solutions rather than license or buy it from others. We will briefly cover some relevant detail about these. Talk will cover use cases of the need for security compliance, FIPS standard and even beyond it. Some practical guidance on how to be security aware while programming with Apache Spark on a FIPS compliant environment. And will also cover some challenges in setting up the environment itself, depending on the time slot given. Prashant Sharma System Software Engineer, IBM Open source contributor, part of the CODAIT (Center for Open Source Dataand AI Technologies) group at IBM. Apache Spark committer and PMC member.