$V2EX
Solana
Give SOL to Copy Address
使用 SOL 向 askfermi 打赏,数额会 100% 进入 askfermi 的钱包。
askfermi's repos on GitHub
46 watchers
crosstalk-dataset
The Crosstalk Dataset
7 watchers
uzh-info2-cheatsheet
UZH Informatics-II Cheatsheet
JavaScript · 3 watchers
nsfw-filter
An Chrome Extension that automatically deletes porn images.
Python · 3 watchers
style-transfer
A Style Transfer in TensorFlow based on fast-neural-style-tensorflow
Jupyter Notebook · 2 watchers
covid-sentiment
Covid-19 Pandemic Sentiment Analysis of Twitter data
Python · 1 watchers
diversity-in-open-source
The Code for "Diversity in Open Source Software and its Impact on Code Quality"
Rust · 1 watchers
EurusDB
EurusDB is a self-learned database
Python · 1 watchers
IconBuilder
A Simple tool for building icons in different pixels
HTML · 1 watchers
ml
Questions about Machine Learning
HTML · 1 watchers
photo-stream
My Photos - Driven by Photo-Stream
Python · 1 watchers
pystitch
Python Binding for Pano Tools and Hugin
0 watchers
.github
Community health files for the @GitHub organization
Rust · 0 watchers
996.ICU
Repo for counting stars and contributing. Press F to pay respect to glorious developers.
Python · 0 watchers
adaptive_ml
Adaptive ML Experiments
0 watchers
AID
One-stop AIOps System.
Python · 0 watchers
area4
🚀 Dividers in Python, the easy way! (As seen on PyPI)
Python · 0 watchers
autokeras
accessible AutoML for deep learning.
0 watchers
awesome-ai-systems
AWESOME AI SYSTEMS
0 watchers
Awesome-ML
Awesome Machine Learning Resources
0 watchers
awesome-mlops
A curated list of references for MLOps
Python · 0 watchers
BitBLAS
BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
Python · 0 watchers
CapsNet-Tensorflow
A Tensorflow implementation of CapsNet(Capsules Net) in Hinton's paper Dynamic Routing Between Capsules
JavaScript · 0 watchers
cf-workers-status-page
Monitor your websites, showcase status including daily history, and get Slack/Telegram/Discord notification whenever your website status changes. Using Cloudflare Workers, CRON Triggers, and KV storage.
TypeScript · 0 watchers
chatbot-ui
The open-source AI chat interface for everyone.
0 watchers
cloud-comp-arch-project
Starter code for semester project in Cloud Computing Architecture course at ETH Zurich
Python · 0 watchers
CNNGestureRecognizer
Gesture recognition via CNN. Implemented in Keras + Theano + OpenCV
0 watchers
ConfNet
Config the Neural Network with a Configuration File
Vue · 0 watchers
covid-19
COVID-19 Stats and Prediction
HTML · 0 watchers
cvtron-status
PHP · 0 watchers
Database-Visualizer
An elegant tool for data visualization
0 watchers
dataperf
Data Benchmarking
Python · 0 watchers
datascope
Measuring data importance over ML pipelines using the Shapley value.
0 watchers
datasets
TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...
0 watchers
dcbench
A benchmark of data-centric tasks from across the machine learning lifecycle.
Python · 0 watchers
deepfakes_faceswap
from deekfakes' faceswap: https://www.reddit.com/user/deepfakes/
Python · 0 watchers
deeplab_v3
Implementation of the Semantic Segmentation DeepLab_V3 CNN as described in: https://arxiv.org/pdf/1606.00915.pdf
JavaScript · 0 watchers
docs
My Documents
MDX · 0 watchers
documentation
Go · 0 watchers
easeml
A Scalable Auto-ML System
0 watchers
face-warehouse
An example warehouse with CVPM for storing facial features, recognizing faces and etc.
C++ · 0 watchers
FasterTransformer_GLM
Transformer related optimization, including BERT, GPT
0 watchers
fmengine
Utilities for Training Very Large Models
0 watchers
GAN-Papers
GAN papers
0 watchers
GoAuthentication
Serverless OAuth Login Tool
JavaScript · 0 watchers
gohttpserver
The best HTTP Static File Server, write with golang+vue
0 watchers
gosql
🐥The very simple ORM library for Golang
0 watchers
GSOC2020
Mozilla and GSOC 2020
0 watchers
hugo-book
Hugo documentation theme as simple as plain book
CSS · 0 watchers
hugo-hero-theme
hugo template for autoai landing
0 watchers
hypopg
Hypothetical Indexes for PostgreSQL
Vue · 0 watchers
iftwx
If XXX then wechat me!
Go · 0 watchers
imageserver
Image server toolkit in Go
0 watchers
lab
my utilities to run lab experiments
CSS · 0 watchers
leap-day
Leap day is a Jekyll theme for GitHub Pages
0 watchers
learned-index
6.867 Course Project
0 watchers
Learned-Index-Structures
Learned Index Structures
TeX · 0 watchers
lecture-notes
My Lecture Notes at ETH/UNI Zurich
JavaScript · 0 watchers
logo-generator
Mesos Framework logo generator
0 watchers
mamba
0 watchers
mctx
Monte Carlo tree search in JAX
0 watchers
mergekit
Tools for merging pretrained large language models.
MDX · 0 watchers
mintlify-docs
MDX · 0 watchers
mintlify-starter
0 watchers
mirage
A multi-level tensor algebra superoptimizer
0 watchers
mkdocs-material
Documentation that simply works
HTML · 0 watchers
ml-updates
0 watchers
mlcourse-solutions
Solutions for ML Course
0 watchers
mlmath
Math for Machine Learning
0 watchers
mlops.toys
🎲 A curated list of MLOps projects, tools and resources
Python · 0 watchers
MNIST_center_loss_pytorch
A Pytorch implementation of center loss on MNIST
0 watchers
model-launch
A CLI app for launching LLM/VLM models on clusters.
Python · 0 watchers
model-verifier
Objective-C · 0 watchers
NewEBuy-master
suning_ebuy
Jupyter Notebook · 0 watchers
openke-review
Review OpenKE: Project for Semantic Web Engineering
C++ · 0 watchers
openpose
OpenPose: Real-time multi-person keypoint detection library for body, face, and hands estimation
0 watchers
OpenTela
OpenTela is a decentralized compute fabric for running machine learning applications.
C · 0 watchers
postgres
Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see https://wiki.postgresql.org/wiki/Submitting_a_Patch
0 watchers
postgresml
PostgresML is an end-to-end machine learning system. It enables you to train models and make online predictions using only SQL, without your data ever leaving your favorite database.
Python · 0 watchers
praise
A Python implementation of Praise in R
0 watchers
psql-hooks
Unofficial documentation for PostgreSQL hooks.
Python · 0 watchers
pybrain
Spike Neural Network Framework
JavaScript · 0 watchers
Randomuser.me-Node
Source code that powers randomuser.me
0 watchers
reproducibility
Rust · 0 watchers
rustcv
0 watchers
sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
0 watchers
shanshui
Shanshui
HTML · 0 watchers
sklearn-transforms-cloud
0 watchers
slidev-theme-zhozhoba
A zhozhoba theme for Slidev.
JavaScript · 0 watchers
sotaweb
Sota Research Web Application
0 watchers
Sparse-Marlin
0 watchers
sphinxcontrib-mermaid
Mermaid diagrams in yours sphinx powered docs
0 watchers
sqlmodel
SQL databases in Python, designed for simplicity, compatibility, and robustness.
0 watchers
starters
Railway starters
C++ · 0 watchers
tensorflow
Computation using data flow graphs for scalable machine learning
Go · 0 watchers
tg
Send Telegram Message After a long-rung shell command finish.
0 watchers
ThunderKittens
Tile primitives for speedy kernels
Python · 0 watchers
torchtune
A Native-PyTorch Library for LLM Fine-tuning
0 watchers
triton
Development repository for the Triton language and compiler
0 watchers
Up
askfermi

askfermi

V2EX member #68592, joined on 2014-07-21 22:53:53 +08:00
Per askfermi's settings, the topics list is hidden
Deals info, including closed deals, is not hidden
askfermi's recent replies
@ferock 有点像但也不完全一样,我的几个需求
1) 我希望能用自带的 model

2) 我希望能自己写一些固定的 workflow 来简化我的流程,我不需要全部都由 LLM 生成,我可以自己写一个 function 之类的给 LLM 来调用

3) 我不是很喜欢在 cli 对话这种体验( coding 当然没问题,但其他的任务感觉不是很必要),我希望能融入到我的 workflow 里,比如我可以 cat kubectl get pods | vibe run docqa -q "summarize what happened"。
Aug 2, 2025
Replied to a topic by ota 服务器 gpu 服務器還有哪裏更便宜?
Feb 16, 2024
Replied to a topic by 1F357 算法 求助估算队列剩余处理时间的问题
听起来像是 queuing theory 的问题,不过多个队列的问题没怎么研究过,可能可以用 queuing theory 作为关键词搜搜
Jan 8, 2024
Replied to a topic by askfermi 分享创造 去中心化的大模型 LLM 服务
@lyang 我也想过这个方案,会有两个问题:1. 会有一些资源浪费 2. 由于 llm 生成本身有一些随机性,会导致没办法期待完全一样的结果。
Jan 8, 2024
Replied to a topic by askfermi 分享创造 去中心化的大模型 LLM 服务
@GeekGao 是的 目前 workload 会随机在支持同一模型的节点里随机分配,监控和其他的目前没实现,估计需要下一个大版本
Jan 5, 2024
Replied to a topic by askfermi 分享创造 去中心化的大模型 LLM 服务
@nikola11 说的很对,这可能可以以后研究一下 :)
Jan 5, 2024
Replied to a topic by askfermi 分享创造 去中心化的大模型 LLM 服务
@sentinelK
1/ 虽然这个交互平台是中心化的,但 api 的接口(或者说在实际调用计算之前)是去中心化的。用户可以在本地跑一个节点,之后调用这个节点提供的 api ,并把 request 分配到网络里的所有节点上。你也可以跑一个自己的 bootstrap node ,让朋友们加入这个 bootstrap node 。这应该也能回答 2/。
2/ 除此之外,其实商业化并不是这个项目的目标,我的目标是想知道在去中心化的情况下如何验证结果的正确性,如何合理的分配激励,如何调度计算资源等等。
3/ 目前没想到什么好办法,目前的想法是可以不断地对每个节点进行验证,每一个 request 可能被分配到 2 个以上的 node 上。
Jan 5, 2024
Replied to a topic by askfermi 分享创造 去中心化的大模型 LLM 服务
@lithiumii 有点像,但 petals 太慢了
Jan 5, 2024
Replied to a topic by askfermi 分享创造 去中心化的大模型 LLM 服务
@peterchen26 没错,基本上就是这样
Jan 5, 2024
Replied to a topic by askfermi 分享创造 去中心化的大模型 LLM 服务
@nbndco 这确实是一个我也在尝试实现的问题,我目前的想法是:
- 编译过程里加一个签名,之后在注册到网络的时候需要提供这个签名,保证运行的程序是唯一的。
- 对请求的回复也进行签名和验证,时不时验证返回的回复是不是正确的。

但目前我还没实现这个功能 :(
About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   2962 Online   Highest 6679   ·     Select Language
创意工作者们的社区
World is powered by solitude
VERSION: 3.9.8.5 · 40ms · UTC 13:29 · PVG 21:29 · LAX 06:29 · JFK 09:29
♥ Do have faith in what you're doing.