The fingerprint from an embedding is a vector (a long list of numbers); a vector database is a filing system built to find similar fingerprints fast, across millions of documents.
Why it matters: mostly so the term doesn't scare you in vendor meetings — "vector database" means "the search index for meaning-based lookup," nothing more exotic.
Related: Embedding