Python inference client

Good for integrations with other libraries like langchain and llamaindex and for increased user visibility.

May be useful for in-house LLM, fine-tuning and batch jobs, also to decouple from OpenAI client.