A user on Reddit is struggling to fine-tune the Jina-v5 embedding model for a Slovak legal corpus. Despite multiple attempts and parameter adjustments, the model consistently fails to grasp the nuances of Slovak syntax, particularly in distinguishing between similar concepts like "theft" and "forfeiture" in legal contexts. The user details their process, including using Qwen/qwen3.5-397b-a17b for relevance scoring and applying a retrieval LoRA fine-tuning on Jina-v5 with specific parameters. AI
IMPACT Highlights challenges in fine-tuning embedding models for nuanced legal language, particularly for less common language syntaxes.
RANK_REASON User is detailing a personal struggle with fine-tuning an existing model, not announcing a new release or significant development.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →