Fintech startup, variety of roles including building natural language abstractions for our product. Utilizing closed models from openai, anthropic, etc.
Engineering lead in the internal cloud of Meta. Hands on experience on scheduling, containers, hosts/gpu configuration (meta-internal equivalents of kubernetes, docker, etc).
This paper + talk goes into details of the system. https://www.usenix.org/conference/osdi20/presentation/tang