πΆπ£π΅πΌπ»π² 17π² ππ πΆπ£π΅πΌπ»π² 16π²: ππ²πΉπΈ π―ππ±π΄π²ππΊπΌπ±π²πΉ πΊπΌπ²π π·π² πΈπΆπ²ππ²π»?
Apple heeft met de iPhone 17e een opvolger van de iPhone 16e, maar wat is er precies nieuw in dit toestel in vergelijking met de voorganger? Wij zetten alle verschillen tussen de budgetmodellen voor je op een rijtje.
This paper presents Extract-0, a 7-billion parameter language model specifically optimized for document information extraction that achieves performance exceeding models with parameter counts several orders of magnitude larger. Through a novel combination of synthetic data generation, supervised fine-tuning with Low-Rank Adaptation (LoRA), and reinforcement learning via Group Relative Policy Optimization (GRPO), Extract-0 achieves a mean reward of 0.573 on a benchmark of 1,000 diverse document extraction tasks, outperforming GPT-4.1 (0.457), o3 (0.464), and GPT-4.1-2025 (0.459). The training methodology employs a memory-preserving synthetic data generation pipeline that produces 280,128 training examples from diverse document sources, followed by parameterefficient fine-tuning that modifies only 0.53% of model weights (40.4M out of 7.66B parameters). The reinforcement learning phase introduces a novel semantic similarity-based reward function that handles the inherent ambiguity in information extraction tasks. This research demonstrates that task-specific optimization can yield models that surpass general-purpose systems while requiring substantially fewer computational resource.
iCulture.nl
N-gated Hacker News