Pull down to go back
Hitoku: Open-source local macOS AI assistant powered by Qwen 3.5 and Gemma 4
opensourcereddit

Hitoku: Open-source local macOS AI assistant powered by Qwen 3.5 and Gemma 4

Hitoku：開源 macOS 本機語音助手，支援 Qwen 3.5 與 Gemma 4

Meet Hitoku, a voice-first AI assistant that runs entirely on your Mac—no cloud, no data leaving your machine. It supports Qwen 3.5 and Gemma 4 for text generation, with multiple speech-to-text options (Parakeet, Whisper, Qwen3-ASR). What makes it special: it's context-aware, meaning it reads your screen, documents, and active apps to understand what you're actually working on. You can query PDFs, reply to emails, create calendar events, and search the web—all by voice. It's fully open-source, so you can inspect and modify it however you want.

Read original →

Keywords

open-sourcelocal AIvoice assistantcontext-awareprivacyQwen3.5Gemma4WhisperSTTon-device

Related Articles

TRELLIS.2 image-to-3D now runs on Mac (Apple Silicon) - no NVIDIA GPU needed
Open SourceRead

TRELLIS.2 image-to-3D now runs on Mac (Apple Silicon) - no NVIDIA GPU needed

I ported Microsoft's TRELLIS.2 to run on Apple Silicon via PyTorch MPS. The original depends on five CUDA-only compiled extensions (flex_gemm, flash_attn, o_voxel, cumesh, nvdiffrast) that have no Mac equivalent. Wrote replacement backends from scratch: Pure-PyTorch sparse 3D convolution (replacing flex_gemm), Python mesh extraction using spatial hashing (replacing CUDA hashmap ops in o_voxel), SDPA attention for sparse transformers (replacing flash_attn), and GPU-accelerated trilinear interpolation (replacing cumesh and nvdiffrast).

Reddit
Show HN: Run TRELLIS.2 Image-to-3D generation natively on Apple Silicon
Open SourceRead

Show HN: Run TRELLIS.2 Image-to-3D generation natively on Apple Silicon

I ported Microsoft's TRELLIS.2 (4B parameter image-to-3D model) to run on Apple Silicon via PyTorch MPS. The original requires CUDA with flash_attn, nvdiffrast, and custom sparse convolution kernels: none of which work on Mac. I replaced the CUDA-specific ops with pure-PyTorch alternatives: a gather-scatter sparse 3D convolution, SDPA attention for sparse transformers, and a Python-based mesh extraction replacing CUDA hashmap operations. Total changes are a few hundred lines across 9 files.

Hacker News
157
Which Qwen 3.6 Quantization Works Best for M5 Pro with 24GB RAM?
Open SourceRead

Which Qwen 3.6 Quantization Works Best for M5 Pro with 24GB RAM?

A user with an M5 Pro machine featuring 24GB of RAM is trying to figure out the best quantization level for running Qwen 3.6 via Ollama. They're unsure whether to go with Q4 (4-bit quantization) but can't find a solid Q3 (3-bit) alternative. They're looking for recommendations on which version would run smoothly on their setup without compromising too much on quality.

Reddit