hi,
which web server framework is the most suitable for libtorch development ?,
regards
Hey!
Why do you need to do C++ development there? For large language models, projects like GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs work pretty well from python !