Newton, Massachusetts, United States
•Designed and implemented overall solution architecture in AWS cloud
•Built initial NLP product via custom built domain specific decision trees with semantic interconnections
•Later migrated to AI based NLP utilizing LLMs for NLU and NLG as needs dictated
•Analyzed LLM performance in different contexts for pharmaceutical education
•Utilized GPT 2-4.5 and Llama2 as performance and security needs dictated
•Architected and implemented Python microservices using copilot to support thousands of requests per minute
•Built CICD pipeline to quickly deploy changes pushed to Github directly to our AWS services
•Developed MySQL database structure, data architecture, and REST interfaces for patient data
•Created comprehensive testing methodology to minimize patient-facing bugs and build customer confidence
•Evaluated VecDB options for RAG including pinecone and vectorized SQL
•Deployed comprehensive LLMops solution with Vellum to speed up development speed and rapidly deploy
•Created and assigned two-week sprint tasks to continuously drive agile projects forward
•Mentored intern on software development and data analysis by overseeing progress and guiding work direction
•Identified and implemented organization-wide compliance policies and architectures for Soc2 and HIPAA
•Researched, presented and resolved legal and regulatory issues related to product development and FDA approval