Senior Software Engineer
Alphasense
Total years of experience :0 years, 7 Months
Worked on developing Summarization and Sentiment analysis feature in organization's financial search engine platform Flask, NLP, AWS, OpenAI, Mysql, Qdrant, Elasticsearch, Mistral, and Llama.
▪ Developed AI Assistant microservice for search platform with search, citation, summarization, and model selection feature for enterprise clients using Python, Langchain, OpenAI, Mistral, Flask, and Elasticsearch.
▪ Redesigned the in-house propriety LLM microservice to support least connection load-balancer and global rate limiter using envoy-proxy.
▪ Improved the performance of in-house LLM microservice using quantization, TensorRT, Pipelines and Kubernetes.