utun2

Commit Graph

Author	SHA1	Message	Date
evgeny	a97e8bcc1f	docs: update file inventory and module header contracts Refresh both AGENTS guides and clarify module purpose, usage, ownership, threading, return values and wire formats in headers. Remove the unused timeout_heap freed_count field and unimplemented getter.	3 weeks ago
evgeny	4cabbc32f5	Fit file chunks within the signed router packet limit	3 weeks ago
evgeny	b47918fad5	Keep media publication and durable deletion off the event loop	3 weeks ago
evgeny	e47c7fb2ac	Allow file owners to revoke active transfers on custody expiry or deletion	3 weeks ago
evgeny	f39ba840b8	Add bounded signed file transfers with per-operation CM ownership	3 weeks ago
evgeny	72fee9e245	Separate core, UTUN and chat lifecycles with owned asynchronous work	4 weeks ago
evgeny	8a9d8d0097	fix: утечки памяти в router-сервисах и при shutdown - conn_mgr_router_recv_handler / md_etcp_recv не освобождали entry (рантайм-утечка на каждое сообщение) - reality_relay: registry + shutdown hook (отложенный free не отрабатывал при остановке) - etcp_router: uasync_drain_immediate после destroy (router_close_finalize) - мелкие callback-списки: activity_cbks, node_cbks, props_cbks/apply_cbks	1 month ago
evgeny	6e2a2f0011	media_download: сброс таймера простоя при CONN→REQ + правки диагностики - md_dl_conn_cb: обнулять last_progress_tb при переходе CONN→REQ, иначе время установки indirect-соединения (~2с) засчитывается как простой блока и вызывал преждевременный фейловер с держателя, реально имеющего блок - STALL-лог: печатать миллисекунды корректно (значение в единицах 0.1мс /10) - media_index: INSERT OR IGNORE — повторная регистрация блока как servable больше не шумит как ERROR (UNIQUE constraint)	1 month ago
evgeny	1fce405204	debug: вычистить логи из категории DEBUG_CATEGORY_DEBUG (удалить дампы, перекатегоризовать ERROR-проверки в ETCP)	1 month ago
evgeny	73fe99b33f	dm: прямой обмен сообщениями (DM) + soundtouch + архитектура звонков - src/dm/: dm_core/dm_crypto/dm_mailbox — прямой обмен сообщениями (DM) - lib/soundtouch-master/: vendored SoundTouch (изменение темпа/высоты аудио) - doc/dm_arch.md, doc/chat_call_arch.md: архитектура DM и звонков - tests: test_dm.c, test_dm_e2e.c - chat: рефакторинг chat_* модулей, member_sync, invite_build - chatgui/chatgui-android: синхронизация с новым API чата - lib/u_async, debug_config, utun_instance: сопутствующие изменения	1 month ago
evgeny	7c8d65db78	chat: локальное удаление канала (Android) + db_sync инстансы в куче	1 month ago
evgeny	a823898379	chat/media: докачка недостающего медиа после стартовой синхронизации + HAVE_BLOCK анонс локальных блоков	1 month ago
evgeny	265008961a	conn_mgr: кандидаты-посредники из topo_node-списка (активные соединения); гейт md_super_connect по is_supernode; откат ping→best_candidates	1 month ago
evgeny	2045d4a169	media: восстановить conn_mgr_open (DIR/REV/IND) + популяция best_candidates из RTT + watchdog не трогает CONN-блоки	1 month ago
evgeny	905fde5a27	media: BLOCK_REQ транзитом — убрать требование прямого соединения (NAT-узлы качают через роутер)	1 month ago
evgeny	0055c2c6fe	media: фикс детекта суперузла (json_flat_get), backfill осиротевших медиа, fallback на автора при пустом QUERY_RESP	1 month ago
evgeny	42a94aa916	BGP: фикс владения адресами в реестре (мульти-группа), проброс group_id в сервис (conn_mgr per-group), membership-фильтр create_group; тест media через chat-группу	1 month ago
evgeny	6c9a47b201	media_delivery: диагностика маршрутизации md_send/md_dl_send/router_deliver (conn, subcmd, no-route) + тест test_media_delivery_chat	1 month ago
evgeny	f28d3e91f7	media: рефакторинг загрузки блоков — конечный автомат, фейловер, watchdog простоя - media_download: состояние блока (IDLE/CONN/REQ/RECV/WAIT/DONE/FAILED), кандидаты-держатели (MD_MAX_HOLDERS_PER_BLOCK), фейловер + ретраи (MEDIA_DL_MAX_ATTEMPTS), watchdog простоя (MEDIA_DL_STALL_TIMEOUT_TB) вместо фейкового времени - media_delivery: настраиваемые dl_stall_timeout_tb / dl_max_attempts - chat_msg: пометка ошибки скачивания в local_attrs ("st":"er") для UI - tests: новый test_media_download_timeout (watchdog/фейловер), рефакторинг test_media_delivery_download/full - chatgui-android: состояние 'error' у вложений/видео (иконка + tap to retry)	2 months ago
evgeny	2d04bf941b	etcp_router: вынести подпись/шифрование в route_crypto, одна функция отправки с флагами - route_crypto_encode/decode: автономный пред/пост-обработчик пакета (encrypt-then-sign, стандартный Ed25519 вместо sc_stream_sign) - одна функция отправки etcp_route_send/etcp_router_conn_send с bitmask mode - формат доставки: [svc_id][src][dst][rx_flags][payload] (статус подписи/шифрования) - ROUTER_INFLIGHT хранит финальный wire-пакет (чинит потерю подписи при ретрансмите) - дедуп инициализации: router_conn_reset/free_queues - учёт inflight через inflight_q count (seq присваивается на enqueue)	2 months ago
evgeny	656da48e35	topo_group: асимметричный старт BGP (JOIN_GROUP) + вынос group_id/flags из TOPO_NODE - UTUN: BGP инициирует только сторона-клиент ([client]) и явные etcp_connect; сервер добавляет пира по JOIN_GROUP (фикс обратного маршрута: сервер не создавал узел клиента из-за дедупа senders_list) - topo_group_new_conn: conn_add_path до дедупа; handle_request_table без add_to_senders - TOPO_NODE: убраны group_id/flags (shared-реестр), передаются в topo_node_serialize - routing/control_server: явный TOPO_GROUP_UTUN - CHAT: гейт по peers_* (get_member_channels) + пассивное add/remove в member_sync - tests: тесты адаптированы (route_ping ждёт registry+v4_addrs) - chatgui-android: voice_recorder_init в utun_bridge_voice_start (idempotent)	2 months ago
evgeny	326dfd7e2c	media_delivery: маршрутизация всегда через CHAT-группу media_download/медиа-ответы и суперузловая репликация теперь берут группу из контекста (dl->group_id, group_id из пакета, peer->group_id) вместо хардкода TOPO_GROUP_UTUN. node_props_changed получает channel_id. SUPER_HELLO несёт group_id.	2 months ago
evgeny	55da8fd146	media_delivery: логирование отправки QUERY_RESP и провалов md_send	2 months ago
evgeny	f47ad7d87f	tcp_proxy: fix throughput (tx_queue backpressure) + connect timeout + integration test - Router: unified service delivery format [svc_id][src][dst][payload] (end-to-end src/dst from SVC_ROUTE header) - tcp_proxy_client: replace single tx_buf drop-on-backpressure with bounded tx_queue + send_q waiter + retry timer (no data loss, bulk window reopen — removes 62.5ms delayed-ACK stall) - tcp_io: configurable connect timeout (tcp_conn_set_connect_timeout) - tcp_proxy_server: connect_timeout config option (ms, default 2000, 0=off) - check.sh: run tcp_proxy_full integration test with sudo (skip if passwordless sudo unavailable) - test_tcp_io: connect timeout unit test; docs (lwip_nuances.md)	2 months ago
evgeny	aee44943fa	topo: invite вынесен в topo_group_invite, conn_mgr упрощён до 3-фазного open; member_sync: полный пересчёт merkle-дерева при старте - topo_group_invite.c/h: invite/join через DIRECT + INVITE_INFO_REQ/RESP (из conn_mgr) - conn_mgr: conn_mgr_open_invite → conn_mgr_open, убран invite-режим (-480 строк) - topo_group_connect: подключение через node_conn_direct вместо conn_mgr - member_sync: _rebuild_all_trees сносит merkle_tree_hash канала и собирает заново из peers (чистка осиротевших листов) - member_sync: хеш блока A/B (update_sig/adm_tags) в док-комментариях - обновлены doc-файлы и тесты	2 months ago
evgeny	f2228202e3	fix: FORTIFY vsnprintf crash on Android + foreground service type Root cause: etcp_on_up/etcp_on_down/etcp_conn_process_send_queue used fixed buffers (links_str[256], l_status[256]) with snprintf chains in loops over links. With 15+ links (IPv6 addresses), sizeof(buf)-offset turned negative → vsnprintf size=(size_t)(-17) → FORTIFY abort on Bionic. Fixes: - lib/strbuf.h/c: safe growable printf buffer (auto-realloc) - etcp.c: 3 snprintf chains → strbuf - debug_config.c: BUF_ADVANCE macro prevents offset overflow - android_jni_bridge.c: bridge_log va_list fix, set_member_flags guard - chat_core.c: TAGS_ADVANCE macro in tags_commit - AndroidManifest.xml: dataSync→specialUse (time limit exhausted) - stcp: ed25519 pubkey exchange, tcp link addr/status in JNI bridge - etcp_router: encrypted flag + ECDH per peer-pair - node_conn_direct: TCP link support - topo_node: group nodes cleanup - media_delivery: buffer overflow fix - test_stcp: ed25519 key exchange test - tests: invite_group_create + Makefile update	3 months ago
Evgeny	2cba839de4	Убрал DEBUG_CATEGORY_DEBUG: сообщения разбросаны по модульным категориям (+CHAT=25, MEDIA=23)	3 months ago
evgeny	7f901c01e1	etcp: переупорядочить close + защита state==2 во всех API-точках; topo: правильная очистка group nodes и registry; chat/member: новый модуль member_sync; chatgui: обновления транспорта и UI	3 months ago
evgeny	38c9f229bc	stcp: ed25519 pubkey exchange in handshake, fix instance destroy segfault, fix chat_tcp_test - u_async.c: process immediate_queue BEFORE epoll_wait in uasync_poll - stcp_link.c: defensive NULL etcp_conn/etcp_link in stcp_link_close - utun_instance.c: move stcp_server_list_destroy_all to Phase J (before ETCP), add deferred drain in both Phase J and L - stcp.h/c: STCP_HS_ENC_CLIENT 6→38, STCP_HS_ENC_SERVER 7→39, exchange ed25519_pubkey in both handshake directions - etcp_connections.c: copy peer_ed25519 from STCP to ETCP_CONN in etcp_link_enter_ready_tcp; guard link->etcp in tcp_link_close_cb - chat_sync.c: fix lk->conn NULL dereference for TCP links - test_stcp.c: update stcp_server_create/stcp_client_connect callsites - tools/chat_tcp_test: change transport udp→tcp	3 months ago
evgeny	d773f1724a	refactor: STCP connections as ETCP links (is_tcp) - Add is_tcp, tcp_link, tcp_reconnect_* fields to ETCP_LINK - Remove transport_link from ETCP_CONN, add tcp_link_count - stcp_link: replace embedded etcp_conn with pointer; add etcp_link backpointer - stcp_link: link_rx_cb routes ETCP data to etcp_conn_input - stcp_link: call on_close_cb in close - New TCP functions: etcp_link_enter_ready_tcp, etcp_tcp_link_start_connect, etcp_tcp_link_start_reconnect, tcp_link_close_cb, etcp_tcp_send - etcp_link_new: handle NULL conn for TCP links; skip enter_init for TCP - etcp_link_close: close stcp_link for TCP - etcp_encrypt_send: redirect TCP to etcp_tcp_send (skips AES-CCM) - tcp_server_on_link: create ETCP_LINK(is_tcp=1) + enter_ready_tcp - etcp_connect: TCP addrs -> etcp_tcp_link_start_connect - Remove ctx->tcp_link/tcp_ready - test_stcp_traffic: find stcp_link via links->is_tcp instead of transport_link - 66/68 tests pass; 2 STCP tests expected to fail (integration not complete)	3 months ago
evgeny	ef637d33a6	auto_socket: модуль авто-управления сокетами при изменении сетевых интерфейсов + fix pre-existing ASAN-багов - auto_socket.c/h: создание/удаление UDP сокетов автоматически при изменении интерфейсов через netlink/route socket При auto_sockets=yes пропускает ручные [server] сокеты Тип сокета: PUBLIC если публичный IP, иначе NAT Для новых сокетов добавляются линки ко всем активным NCD-соединениям При удалении интерфейса линки убираются, сокет закрывается Platform-agnostic API для использования из Android/chatgui - node_conn_direct.h/c: ncd_add_socket_links / ncd_remove_socket_links — управление линками на конкретном сокете - socket_monitor.h/c: экспорт socket_monitor_update_if_addr для auto_socket - config_parser.h/c: опция auto_sockets в [global] - init_sockets(): пропуск ручных сокетов при auto_sockets=yes - utun_instance: интеграция auto_socket_init/destroy - media_delivery: fix stack-buffer-overflow ack[3] → ack[9] - topo_node: fix heap-use-after-free в topo_group_update_my_nodeinfo — сохранение node_id/ver перед registry_store, использование return value	3 months ago
Evgeny	fa5878ef4b	media_download: fix md_mkdir_parent for Windows (drive letter, backslash), add errno to fopen errors, sanitize base_filename with WARNING	3 months ago
evgeny	de9e467b39	media_delivery: BLOCK_PROCESSING + relay streaming + per-file download limit - block_availability: status column (0=processing, 1=completed) - md_ba_complete_block(): DELETE old + check exists + INSERT new id - BLOCK_PROCESSING subcmd (0x10) — INSERT with new id, no REPLACE/IGNORE - BLOCK_RELAY_FULL subcmd (0x11) — redirect when source/relay at capacity - relay_block_ctx: downstream forwarding from chunk file - md_file_load: per-file source download limit (max_downloads_per_file) - RELAY_FULL from source node when at capacity - relay_full handler: retry existing peers, not just new ones - sync.md: full documentation	3 months ago
evgeny	7263bdcf56	media_download tests: backpressure, block relay, OOB block_id, assembly 5 new tests in test_media_delivery_download: - conn_cb starts only first block (backpressure) - conn_cb with multiple peers - BLOCK_DONE triggers next block relay from same peer - assembly after all blocks validated - peer with more blocks than dl (OOB fix verification) md_dl_conn_cb made non-static for test visibility md_dl_send added NULL guard for test instances without routing media_download.h: added conn_cb extern declaration	3 months ago
evgeny	41e9c9b0e6	media_download: fix block_id OOB, add backpressure, close conn_mgr - md_dl_send_block_req now takes explicit block_id (not peer-local index into dl->block_ids) — fixes OOB 'aaaaaaaa...' garbage block_id - conn_cb sends only first unstarted block per peer (backpressure) - BLOCK_DONE success triggers next block from same peer - conn_mgr handles stored in peer->cm_handle, closed on assembly/cancel	3 months ago
evgeny	e1e54df4f4	fix: invite не затирает имя узла, имя читается из member_sync peers.userinfo - conn_mgr_core.c: убрана запись node_name из cm_handle_invite_info_resp - topo_node_sqlite.c: name в nodes не перезаписывается пустой строкой - android_jni_bridge.c: bridge_get_node_name читает peers_<ch>.userinfo если nodes.name пуст	3 months ago
evgeny	7799d54c0c	conn_mgr: обновить API на единую точку входа conn_mgr_open_invite, поправить порядок destroy, обновить всех потребителей - conn_mgr_cb_t: 5 параметров (h, node_id, group_id, event, arg) - conn_mgr_open_invite: единая функция (ni=NULL — обычное, ni!=NULL — invite) - CONN_EVENT_JOIN для успешного invite - struct CONN_MGR_HANDLE: добавлен group_id - bind/unbind в conn_mgr_init/destroy (один на инстанс, перезапись безвредна) - utun_instance_destroy: conn_mgr_destroy до закрытия сокетов - cm_ncd_callback: занулять ncd_handle при DOWN, защита от вызова после destroy - topo_group_connect: свой трекинг handle'ов, conn_mgr_close для отмены - обновлены: topo_recovery, media_download, media_delivery, chat_sync, тесты	3 months ago
evgeny	153483fd96	media_delivery: обновление и новый тест conn_mgr_handles	3 months ago
evgeny	d310bccf08	fix: memory pool alloc mismatch in tests, db_sync SEND_DATA buffer overflow - test_etcp_router_reconnect, test_etcp_connect, test_stcp_traffic: replace u_calloc with memory_pool_alloc for TOPO_SOCKMETA4/TOPO_ADDR4 - db_sync.c: fix req[14] -> req[15] — SEND_DATA request header is 15 bytes (type:1 + from:4 + count:2 + vp:4 + want_from:4)	3 months ago
evgeny	51d6c782ac	voice playback: miniaudio cursor ground truth + EMA smooth decay - SoundManager: add currentPcmCursor()/isCurrentPcmPlaying() via ma_sound_get_cursor_in_pcm_frames / ma_sound_is_playing - messagedelegate: replace wall-clock position tracking with real miniaudio cursor, remove 200ms hardcoded delay - messagedelegate: end-of-playback detection via isCurrentPcmPlaying() instead of wall-clock comparison (was killing audio ~200ms early) - messagedelegate: EMA smoothing of displayFrac/displayElapsed (0.15 factor, 16ms timer) - messagedelegate: timer continues after audio stops to animate EMA decay to 0 (not mouse-move dependent) - media_delivery: download progress callback, Ed25519 sig verify, author fallback, content hash check - conn_mgr: already-connected returns OK with callback instead of error - chatgui: voice download-pending auto-play, file download progress bar, media bar colors	3 months ago
evgeny	70797f921e	feature: media auto-download + manual download + UI download state indication (Android + desktop) C-layer: - chat_event.h: CHAT_EVT_ATTACHMENT_DOWNLOADED (14) - chat_msg.c: fixed md_auto_download (non-NULL done_cb, correct media_base from db_path, use chat_setting for autoload checks) - chat_msg.c: added chat_core_attachment_download + trampoline for manual download - chat_core.h: exported attachment_dl_req + trampoline Android (Kotlin + JNI): - Message: downloadState field (parse from localAttrs) - ChatRepository: parse localAttrs for download state - NativeLib: attachmentDownload() JNI - MessageBubble: FileBubble with download status icon + tap-to-download - ChatViewModel: downloadAttachment() + CHAT_EVT_ATTACHMENT_DOWNLOADED handler - ChatScreen: wire onDownloadFile handler - android_jni_bridge: utun_bridge_attachment_download + JNI + localAttrs in JSON Desktop (Qt/C++): - messagedelegate.h: MsgFileDownloadStateRole, MsgChannelIdRole - messagelist.cpp: parse localAttrs for file download state - messagedelegate.cpp: FileBubble with download icon/text + click handler via chat_core_attachment_download_trampoline - gui_bridge.h: GUI_EVT_ATTACHMENT_DOWNLOADED (14) + callback typedef - gui_bridge_impl.cpp: event dispatch + setter - mainwindow.cpp: callback registration -> refresh message list	3 months ago
evgeny	efbb495016	media_delivery: fix SUPER_REPL spam + streaming verification Bugs fixed: - md_super_peer_add: timeout_tb = 0 → MEDIA_REPL_TIMEOUT_TB (timer fired every poll) - md_repl_retrans_cb: md from peer->connect_timer (garbage) → peer->md - md_repl_retrans_cb: removed inflight_count=0 reset (don't resend acked entries) - stream_ctx: removed unused block_data field (was NULL, caused crash in BLOCK_DONE) Test improvements: - stream_completed flag for reliable streaming verification - File created in <db_dir>/media/ (matches media_index path logic) - 9/9 full test, 33/33 total	3 months ago
evgeny	b4824de3b8	media_delivery: fix streaming crash, correct file path via media dir - Fix NULL block_data deref in stream_send_chunk_cb - Test B1: create file in <db_dir>/media/, commit to media_files - Store media_base in ui_state for streaming handler path resolution - 8/9 tests pass (streaming works but timing issue with SUPER_REPL flood)	3 months ago
evgeny	a6321e15b3	media_delivery: streaming, fallback, admission control, 8/9 tests - md_handle_block_req: real chunk streaming via etcp_router_on_send_ready - stream_ctx state machine: backpressure waiter → send chunk → repeat - content_hash + block_sig on stream completion - Fallback to author when supernode has no block info - media_download: author_node_id for peer fallback - test_media_delivery_full: 8/9 pass (SUPER_HELLO, HAVE_BLOCK, replication, admission, file create) - Known issue: streaming test hung (BGP route for n1→n2 not established in time)	3 months ago
evgeny	57e6ffed16	media_delivery: admission control + OVERLOADED + full integration test - MEDIA_BLOCK_OVERLOADED (0x0F) subcommand + packed struct - Admission control: track active_streams, reject > 3 with OVERLOADED - media_delivery_stream_done() to decrement counter after stream finish - Auto-download trigger in chat_msg.c (parse media metadata, check settings) - test_media_delivery_full.c: 9/9 tests on 4 instances (SUPER_HELLO, HAVE_BLOCK, replication, admission control, OVERLOADED) - All 33 existing tests still pass (15+5+4+9)	3 months ago
evgeny	5e739176fa	media_delivery: fix etcp_route_send svc_id + integration test Root cause: etcp_route_send reads dgram[0] as svc_id, not subcmd. router_deliver prepends svc_id byte on receive. Fixes: - md_send/md_dl_send/msend: prepend ETCP_RT_ID_MEDIA_DELIVERY to dgram[0] - md_etcp_recv: read subcmd from data[1] (was data[0]) - etcp_api.h: document dgram[0]=svc_id convention - media_delivery_set_supernode(): public API for dynamic switching Tests: - test_media_delivery_integration: 4/4 (SERVE_REG, HAVE_BLOCK, supernode stop/start) - All 24 existing tests still pass	3 months ago
evgeny	a863da7737	media_delivery: add tests + fix queue_new NULL ua and index_offset bugs - test_media_delivery_sql: 15 tests (SQL tables, CRUD, packed structs) - test_media_delivery_download: 5 tests (chunk write/append, sig verify, assembly, cancel) - Fix: queue_new(NULL) returns NULL — pass inst->ua everywhere - Fix: queue index offset must be offsetof(struct, key_field) not 0 - Move struct media_download to header for test visibility	3 months ago
evgeny	fb3e34080d	media_delivery: implement full media delivery subsystem (stages 1-8) - topo_group: add BGP node event callbacks (NEW/UPDATE/REMOVE) - member_sync: add multi-subscriber node_props_changed callback (adm_tags) - media_delivery: SQLite tables (block_availability + super_sync), full protocol handler - media_delivery_proto.h: packed protocol structures (15 subcommands) - media_download: download management, chunk streaming, block assembly, HAVE_BLOCK with retry - Makefile.am: add media_download.c to builds	3 months ago
evgeny	7d9cbad8c5	media_delivery: add architecture description and implementation plan	3 months ago
evgeny	65dbfa6813	feat: media_async + media_index modules, media_files table, tests - media_async: thread-per-task async engine with primitives (sha256, sign, copy, uuid, file_size) - media_index: media_files DB table with register_async for indexing chunks - chat_msg: async media submission via register_async, simplified chat_msg_submit fields - voice_recorder/attachment_sender: write single file (no chunk splitting on caller side) - inputbar/messagelist: updated to new simplified submit interface - test_media_async: 4-thread stress test (200K ops / 2 sec, 0 errors) - test_media_index: 9 cases covering commit edge cases + async flow - build: Makefile.am, CMakeLists.txt, utun_sources.cmake updated	3 months ago

50 Commits (c16334d551561b6db86f5ece51a463f4b6edb6f7)