Exactly, filtering is vital. That is why Qdrant offers extended filtering, which happens at the same stage as retrieval, not as pre- or post-filtering, with two stages and an impact on performance and quality.
It is not trivial to implement vector search functionality inside a complex framework that is not initially designed for vectors. Besides that, vector search is not only about semantic search.