Beyond Retrieval: Analytic Memory for Multimodal Agents (AdaMM)

SUP-A30 原表

来源：作者原文。2026-09-07抓取，原始行列，不是统一复跑成绩。

Table 1: Access tools for analytic and retrieval memory.

Memory	Tools	Capability
Analytic	Lookup, Filter, Compute, Rank	Exact record access and deterministic computation.
Retrieval	SemanticMatch, EventLocate	Relevance-based retrieval and event localization.

Table 2: Benchmark statistics.

Benchmarks	Sessions	Rounds	Images	QA pairs
MemEye	221	848	438	742
MemGallery	240	3,962	1,003	1,711

Table 3: Main results on MemEye and MemGallery. Higher is better for all metrics. Bold values denote the best result within a backbone and red values denote improvements over the strongest baseline.

Backbone	Method		MemEye			MemGallery
Backbone	Method		EM	BLEU-1	LLM-Judge	F1	BLEU-1	LLM-Judge
GPT-4.1-nano	Unimodal	A-Mem	39.1	17.1	32.0	53.2	47.2	67.4
	Unimodal	MemoryOS	42.4	15.8	27.6	53.4	47.1	65.9
	Multimodal	M2A	34.1	5.8	13.8	50.2	44.3	61.5
		MMA	39.0	10.6	32.0	55.9	50.7	64.1
		MIRIX	40.9	5.7	13.6	56.3	51.1	66.3
		MM-RAG	42.7	16.6	42.2	58.3	52.4	67.3
		UniversalRAG	43.1	16.5	40.2	57.7	52.4	67.0
		AdaMM (Ours)	50.4(+7.3)	21.2(+4.1)	48.0(+5.8)	62.6(+4.3)	56.7(+4.3)	74.3(+6.9)
GPT-5.4-mini	Unimodal	A-Mem	48.0	22.4	35.2	63.0	58.6	74.4
	Unimodal	MemoryOS	48.7	21.8	33.3	64.5	59.0	75.5
	Multimodal	M2A	40.1	12.3	33.5	60.8	56.0	71.7
		MMA	53.9	25.7	43.3	64.0	59.6	73.3
		MIRIX	46.7	18.0	33.2	65.7	60.9	78.2
		MM-RAG	61.8	29.7	49.4	66.5	61.9	78.7
		UniversalRAG	62.4	30.4	48.6	65.6	60.8	77.4
		AdaMM (Ours)	65.5(+3.1)	35.9(+5.5)	60.7(+11.3)	69.1(+2.6)	64.1(+2.2)	83.9(+5.2)

Table 4: Detailed access-tool specifications for analytic and retrieval memory.

Memory	Tool	Arguments $\Theta_{i}$	Return $\Omega_{i}$	Function
Analytic	Lookup	table; key_values; result_budget	matching_rows	Retrieves records matching the specified keys.
	Filter	table; column_filters; result_budget	matching_rows	Selects records satisfying the specified predicates.
	Compute	table; target_column_expression; operator; optional_column_filters	computed_result; contributing_rows	Performs deterministic computation over a selected table scope.
	Rank	table; target_column_expression; order; optional_column_filters; result_budget	ranked_rows	Returns the top- or bottom-ranked records.
Retrieval	SemanticMatch	query_content; retrieval_scope; result_budget	ranked_memory_units; relevance_scores	Retrieves semantically relevant memory units.
	EventLocate	query_content; result_budget	ranked_memory_units; relevance_scores	Locates event occurrences and their surrounding context.

Table 5: Key hyperparameter settings.

Parameter	Setting
Schema support threshold	$\theta_{s}=4$ rounds
Schema all-confidence threshold	$\theta_{a}=0.60$
Schema extension-confidence threshold	$\theta_{e}=0.80$
Episode similarity threshold	$\theta_{\mathrm{epi}}=0.60$
Topic similarity threshold	$\theta_{\mathrm{topic}}=0.65$
Text/visual fusion weights	$0.60/0.40$
Metadata semantic/token weights	$0.70/0.30$
Retrieved table/episode metadata	$k_{\mathrm{tab}}=k_{\mathrm{epi}}=5$
Maximum planning steps	3
Shared evidence budget	10 units

Table 6: A representative analytic table constructed from the MemEye Health task.

Table name	daily_glucose_dashboard
Description	Longitudinal daily-glucose records that support exact comparison and aggregation of recurring glucose patterns, behavioral targets, and time-in-range trends across interactions.
Columns	source, round_order, captions, date, evening_drift, late_window, meal_variability, morning_response, movement_goal, and time_range.

source	round _order	captions	evening _drift	late _window	meal _vari...	morning _response	movement _goal	time _range
HEALTH_S1:R2	1	Daily dashboard showing … stable glucose trends	2.8	47.0	19.0	84.0	66.0	82.0
HEALTH_S1:R3	2	A sleek daily … time in range	4.3	57.0	16.0	84.0	66.0	80.0
HEALTH_S1:R6	5	Daily Glucose Dashboard … stable glucose trends	2.1	57.0	12.0	84.0	66.0	92.0
HEALTH_S6:R5	42	Daily dashboard showing … metrics for meals	2.2	57.0	27.0	84.0	66.0	90.0
$\boldsymbol{\cdots}$
HEALTH_S8:R6	60	A digital daily … time in range	4.3	57.0	17.0	84.0	66.0	91.0
HEALTH_S12:R8	94	A daily glucose … time in range	1.3	57.0	19.0	84.0	66.0	82.0