Hot Off the Press! UK National Cyber Security Centre – Guidelines for secure AI system development just published

Hot Off the Press! UK National Cyber Security Centre – Guidelines for secure AI system development just published This document has just been published (27th November 2023): https://www.ncsc.gov.uk/collection/guidelines-secure-ai-system-development Our commentary to follow in due course. Url Subscribe Please enter your […]

Playing with Fire – Enterprise Grade ChatGPT Integration – A Compliance Nightmare?

In my previous post I discussed how easy, at least at a technical level, it is to integrate ChatGPT and other LLM providers into your stack by using the Marvin LLM Framework for Python.

So, after a profitable morning of coffee and coding, I’m sending automated requests out happily from my server to ChatGPT when some bright spark in the office asks “Is that actually a safe thing to do?”.

Thankfully, I had done my homework before even considering piping juicy nuggets of corporate data to an external service, that some claim may be the downfall of humanity, so I did have somewhat of a reasoned answer.

Quick and Easy API Integration to ChatGPT and other Large Language Model providers.

We’ve recently been doing some internal process improvement work and just like every man and his dog at the moment, we identified a need to enhance some of our internal automation by integrating to a Large Language Model (LLM) provider such as ChatGPT.

Fortunately, If you’re a Pythonista, this process couldn’t be much simpler – thanks to a new generic AI integration framework called Marvin, from the folks who brought you Prefect Workflow Orchestration: https://www.prefect.io/marvin