Commit Graph

255 Commits

Author SHA1 Message Date
Jaehong Kang 04075ee0be
enhance(backend): Implementation of HTTP header and body validation to fix SIF-2023-002 (#12334)
Using Buffer instead of string

Co-authored-by: perillamint <perillamint@silicon.moe>
2023-11-15 11:13:34 +09:00
syuilo 65c5626b65
Merge pull request from GHSA-3f39-6537-3cgc
This commit implements HTTP header and body validation to fix
[SIF-2023-002](https://advisory.silicon.moe/advisory/sif-2023-002/)

Signed-off-by: perillamint <perillamint@silicon.moe>
Co-authored-by: perillamint <perillamint@silicon.moe>
Co-authored-by: yunochi <yuno@yunochi.com>
2023-11-14 17:09:45 +09:00
syuilo 30bb24d18c update deps 2023-11-14 10:35:48 +09:00
syuilo 1729307fcf update deps 2023-11-03 14:41:21 +09:00
syuilo 77db652bff update deps 2023-11-01 14:06:54 +09:00
syuilo a8dc6d08b1 update deps 2023-10-28 12:31:18 +09:00
MomentQYC 9caae8a10a
feat: Facilitates the rollback of migration operations (#12109)
* Update package.json

* Update package.json
2023-10-23 16:42:54 +09:00
syuilo fdeee5dd05 update deps 2023-10-23 09:20:55 +09:00
syuilo 42a3489bcb update deps 2023-10-20 15:46:12 +09:00
syuilo cc256f117e update deps 2023-10-19 19:51:59 +09:00
syuilo 145c5c8b2b update deps 2023-10-18 09:43:59 +09:00
syuilo e9db0680c4 update deps 2023-10-17 09:04:17 +09:00
syuilo 9338ab461e update deps 2023-10-16 20:13:05 +09:00
syuilo cf6e53b2ac update deps 2023-10-10 16:26:48 +09:00
syuilo 13dbfef9f8 update deps 2023-10-09 20:55:40 +09:00
syuilo 95dc70021f update deps 2023-10-06 17:19:17 +09:00
syuilo ac19b055c7 update deps 2023-09-29 15:11:08 +09:00
syuilo 509cea511c update deps 2023-09-24 11:09:49 +09:00
syuilo 5a4cf059ee update deps 2023-09-23 12:46:19 +09:00
syuilo 032b6c6afb update deps 2023-09-22 16:47:42 +09:00
syuilo 6459eadcf1 update deps 2023-09-21 10:25:44 +09:00
syuilo b9c6992aac
update deps (#11849)
* update deps

* wip

* wip
2023-09-20 16:43:45 +09:00
syuilo 6cf466e5d1
update deps (#11820)
* update deps

* fix

* wip

* wip

* wip

* Update docker-compose.yml.example

* Delete reviewer-lottery.yml

* Update RepositoryModule.ts

* wip

* wip

* clean up

* update deps

* wip

* wip
2023-09-15 14:28:29 +09:00
syuilo ff9a65e8fa
feat: passkey support (#11804)
https://github.com/MisskeyIO/misskey/pull/149
2023-09-08 14:05:03 +09:00
syuilo ca00a08e6e feat: introduce aidx and make it default
Co-Authored-By: MeiMei <30769358+mei23@users.noreply.github.com>
2023-09-06 18:33:51 +09:00
syuilo 59ab4af7ca update deps 2023-09-05 17:43:43 +09:00
syuilo 1f7a81aae7
update deps (#11764)
* update deps

* node16

* wip

* wip

* wip

* Update test-utils.ts

* wip

* Update tsconfig.json

* wip

* Update package.json

* wip

* Update following.vue

* Update followers.vue

* Update index.vue

* Update share.vue

* Update MkUserPopup.vue

* Update MkPostForm.vue

* wip

* Update MkTokenGenerateWindow.vue

* Update MkPagination.vue

* refactor

* update deps

* update deps

* Update sw.ts

* wip

* wip

* wip

* Update FetchInstanceMetadataService.ts

* Update FetchInstanceMetadataService.ts

* update node

* update deps

* 🎨
2023-09-04 13:33:38 +09:00
syuilo 2b4c8c9e0f
update deps (#11409)
* update deps

* Update .eslintrc.js

* Update .eslintrc.js

* lint

* lint

* Update update.ts

* update deps

* Update .eslintrc.js
2023-07-31 19:14:20 +09:00
woxtu 5096be06ac
Remove an unused dependency (#11405) 2023-07-29 15:17:29 +09:00
Kagami Sascha Rosylight eb7b5f905a
feat(backend): support OAuth 2.0 authorization (#11053)
* feat(backend): support OAuth 2.0 authorization

* secureRndstr fix

* nanndekowareta

* nanndekowareta2

* nanndekowareta3

* unref?

* refactor to not close fastify

* use microformats-parser

* Update OAuth2ProviderService.ts

* clarify the reason behind dns lookup

* refactor(backend): use @types/oauth2orize-pkce (#11350)

* refactor(backend): use @types/oauth2orize-pkce

* Update package.json

* Update pnpm-lock.yaml

---------

Co-authored-by: Kagami Sascha Rosylight <saschanaz@outlook.com>

---------

Co-authored-by: mtgto <hogerappa@gmail.com>
Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-07-27 18:51:58 +09:00
Acid Chicken (硫酸鶏) cf3ac3c0be
build: close #10953 2023-07-26 22:06:00 +09:00
Acid Chicken (硫酸鶏) e6fca72171
perf: use slacc instead of unzipper (#10780)
Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-07-20 17:00:54 +09:00
woxtu 5f5c4fc44f
Remove unused dependencies (#11327) 2023-07-20 06:53:35 +09:00
syuilo 54c0ed2ed7 update deps 2023-07-18 20:00:45 +09:00
syuilo 545371011a use happy-dom 10.0.3
Resolve #11287
2023-07-16 07:43:55 +09:00
woxtu b392f44b81
refactor(backend): Improve UUID generation (#11286)
* Replace with `crypto.randomUUID()`

* Remove uuid
2023-07-15 18:39:38 +09:00
syuilo 9a5bc78eb4 update deps 2023-07-15 16:07:30 +09:00
syuilo 1f181536ae use engines 2023-07-08 08:52:51 +09:00
popkirby 8daca59ca6
perf(backend): use mutex for nsfw model loading (#11109)
Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-07-08 07:27:26 +09:00
syuilo d5c4e77c44 update deps 2023-07-07 10:53:06 +09:00
syuilo 8099bc24e1
refactor(backend): use node16 for moduleResolution (#10938)
* refactor(backend): use node16 for moduleResolution

* update deps

* Update tsconfig.json

* ✌️

* revive KEYWORD

* restore strict-event-emitter-types dependency

* restore ms dependency

* cancel redundant import reorder

* fix

* Delete ms.ts

* remove rndstr

---------

Co-authored-by: Kagami Sascha Rosylight <saschanaz@outlook.com>
2023-06-25 21:13:15 +09:00
Kagami Sascha Rosylight ef354e94f2
refactor(backend): replace rndstr with secureRndstr (#11044)
* refactor(backend): replace rndstr with secureRndstr

* Update pnpm-lock.yaml

* .js
2023-06-25 11:04:33 +09:00
Kagami Sascha Rosylight a2c0573f84
refactor(backend): replace private-ip with ipaddr.js (#11041)
* refactor(backend): replace private-ip with ipaddr.js

* restore ip-cidr
2023-06-25 06:35:09 +09:00
syuilo 60cc7f62e6 update deps 2023-06-24 13:11:53 +09:00
syuilo 91d790bbb6 update deps 2023-06-02 11:34:38 +09:00
syuilo f930eaee02
perf(backend): use websockets/ws instead of theturtle32/WebSocket-Node (#10884)
* perf(backend): use websockets/ws instead of theturtle32/WebSocket-Node

Resolve #10883

* refactor

* Update StreamingApiServerService.ts

* Update StreamingApiServerService.ts

* ✌️

* Update StreamingApiServerService.ts

* fix main stream init

* fix timing 2

* setIntervalの重複を避ける(気休め)

* add comment

* ✌️

---------

Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-05-29 13:32:19 +09:00
syuilo fd7b77c542
enhance(backend): migrate bull to bullmq (#10910)
* wip

* wip

* Update QueueService.ts

* wip

* refactor

* ✌️

* fix

* Update QueueStatsService.ts

* refactor

* Update ApNoteService.ts

* Update mock-resolver.ts

* refactor

* Update mock-resolver.ts
2023-05-29 11:54:49 +09:00
tamaina 4129ac157a package.jsonの並び替えを修正 2023-05-25 14:50:14 +00:00
syuilo 1de774fa3d update deps 2023-05-24 10:16:42 +09:00
Acid Chicken (硫酸鶏) 81fd94e635
chore: update slacc (#10867)
Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-05-20 10:34:31 +09:00
syuilo acd5e0b8f6 update deps 2023-05-19 16:34:56 +09:00
syuilo 6f1994c665 update deps 2023-05-12 11:41:53 +09:00
Acid Chicken (硫酸鶏) 4a72941eda
perf: use slacc on check-word-mute (#10721)
* perf: use slacc on check-word-mute when all of specified words are single word

* perf: use slacc as possible

* build: avoid tarball

* chore: update slacc

* build: update package name
2023-05-05 19:49:34 +09:00
syuilo 5c08f2b93b
feat: Introduce Meilisearch (#10755)
* wip

* wip

* Update SearchService.ts

* Update SearchService.ts

* wip

* wip

* Update SearchService.ts

* Update CHANGELOG.md

* wip

* Update SearchService.ts

* Update docker-compose.yml.example
2023-05-05 08:52:14 +09:00
syuilo bcd123371b update deps 2023-05-02 20:52:36 +09:00
syuilo 8c9cb9ee15 update deps 2023-04-19 12:52:14 +09:00
syuilo 5f67ca434d update ioredis 5.x 2023-04-14 10:09:03 +09:00
syuilo 88f22da052 update deps 2023-04-06 20:22:26 +09:00
tamaina 26068a3a8f use workspace:*, use pnpm@8.1.0 2023-03-30 13:01:00 +00:00
syuilo bb2b33f2c9 update deps 2023-03-30 12:03:04 +09:00
Kagami Sascha Rosylight cee1d5e2d0
chore: integrate misskey-js as a workspace item (git subtree) (#10409)
* Additional changes for the merge

* api-misskey-js
2023-03-30 09:33:19 +09:00
Kagami Sascha Rosylight abdb43c440 Revert "Additional changes for the merge"
This reverts commit efb5e1d1cc.
2023-03-25 08:20:34 +01:00
Kagami Sascha Rosylight efb5e1d1cc Additional changes for the merge 2023-03-25 08:13:30 +01:00
YS 658901a47f
bump aws-sdk to v3 for s3 (#10363)
* indent

* aws-sdk v3移行
2023-03-23 13:48:14 +09:00
syuilo c0bad443ff update deps 2023-03-10 14:00:14 +09:00
tamaina c36e7d1a07
enhance(server): メディアプロキシでico,bmpを読めるように (#10186)
* enhance(server): downloadUrlでContent-Dispositionからファイル名を取得
Resolve #10036
Resolve #4750

* untitled

* オブジェクトストレージのContent-Dispositionのファイル名の拡張子をContent-Typeに添ったものにする

* ✌️

* tiff

* fix filename

* add test

* /files/でもContent-Disposition

* enhance(server): メディアプロキシでico,bmpを読めるように
Fix #10120

* comment

* fix test

---------

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-03-04 19:23:11 +09:00
Kagami Sascha Rosylight 61215e50ff
test(backend): APIテストの復活 (#10163)
* Revert 1c5291f818

* APIテストの復活

* apiテストの移行

* moduleNameMapper修正

* simpleGetでthrowしないように

status確認しているので要らない

* longer timeout

* ローカルでは問題ないのになんで

* case sensitive

* Run Nest instance within the current process

* Skip some setIntervals

* wait for 5 seconds

* kill them all!!

* logHeapUsage: true

* detectOpenHandlesがじゃましているらしい

* maxWorkers=1?

* restore drive api tests

* workerIdleMemoryLimit: 500MB

* 1024MiB

* Wait what
2023-03-03 11:13:12 +09:00
syuilo 76f3bdcdf9 update deps 2023-02-26 18:51:45 +09:00
kabo2468 1c9c9745f5
Windows環境でswcを使うと正常にビルドができない問題の修正 (#10074)
* Update @swc/core to v1.3.36

* Update CHANGELOG.md

* Update CHANGELOG.md
2023-02-25 05:22:36 +09:00
Kagami Sascha Rosylight 9edd0d25c2
Pass `--detectOpenHandles` to Jest (#9895)
Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-02-24 14:37:22 +09:00
Masaya Suzuki 6b52403d05
起動時にRedisの疎通確認を行う (#9832)
* 起動時にRedisの疎通確認を行う

* check:connectをstart内に移動

---------

Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-02-24 14:09:17 +09:00
CaffeinePower cde0eb621d
feat(server): add @swc/core-android-arm64 to optional (#10034)
* feat: add optional swc

* fix: windowsで動かない現象を修正

* fix: fix swc path alias

* fix: docker build時に`Host key verification failed`と言われてgitリポジトリからパッケージをインストールできないのでssh -> htpsに変更

* feat(server): add @swc/core-android-arm64 to optional

* fix: conflict
2023-02-23 16:23:16 +09:00
syuilo 4e23500732 use swc 2023-02-23 15:36:47 +09:00
CaffeinePower b965f5e4a9
feat: swc build in windows (#10032)
* feat: add optional swc

* fix: windowsで動かない現象を修正

* fix: fix swc path alias

* fix: docker build時に`Host key verification failed`と言われてgitリポジトリからパッケージをインストールできないのでssh -> htpsに変更
2023-02-23 15:36:17 +09:00
syuilo d1a69abf81 use tsc for build
Windowsだとエラーが出るため
2023-02-23 11:06:23 +09:00
syuilo 28bea88da0
Update package.json 2023-02-23 10:17:00 +09:00
tamaina f7c6ea93d7
perf(backend): Use swc on pnpm build (#10026)
* perf(backend): Use swc on pnpm build

* update CHANGELOG

* no jest
2023-02-22 23:09:24 +09:00
potpro bd13ea3d2c
MFMのDOM ParserをJSDOMからhappy-domに変更する (#10016)
Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-02-22 17:32:45 +09:00
syuilo 716ffcace6 update deps 2023-02-20 17:04:57 +09:00
tamaina 980bf1306e
🎨 2FA設定のデザイン向上 / セキュリティキーの名前を変更できるように (#9985)
* wip

* fix

* wip

* wip

* ✌️

* rename key

* 🎨

* update CHANGELOG.md

* パスワードレスログインの判断はサーバーで

* 日本語

* 日本語

* 日本語

* 日本語

* ✌️

* fix

* refactor

* トークン→確認コード

* fix password-less / qr click

* use otpauth

* 日本語

* autocomplete

* パスワードレス設定は外に出す

* 🎨

* 🎨

---------

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-02-20 16:40:24 +09:00
Kagami Sascha Rosylight dd52be3a01
ci: run typecheck and eslint separately (#9966)
* ci: run typecheck and eslint separately

* fix syntax
2023-02-17 10:57:40 +09:00
tamaina 4e68126c06
enhance(server): URLプレビュー(summaly)はプロキシを通すように (#9905)
* enhance(server): URLプレビュー(summaly)はプロキシを通すように

* update summaly

* update summaly

* 型エラーバスター

* basic.html

* Delete basic.html

---------

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-02-14 14:17:07 +09:00
syuilo 54df243b90 fix: typeorm migrations not working
Fix #9868
2023-02-11 10:49:17 +09:00
syuilo 1ff14d81c1 update deps 2023-02-09 09:25:31 +09:00
syuilo 825551d64f drop syslog
Close #9774
2023-02-03 15:08:36 +09:00
syuilo 65ed702d87 update deps 2023-02-03 14:44:09 +09:00
syuilo 4b43745e7c fix(test): add @jest/globals 2023-02-02 10:26:29 +09:00
syuilo d8f33bc0af update deps 2023-01-27 11:40:18 +09:00
syuilo 30dce42e03 fix deps 2023-01-25 12:17:53 +09:00
syuilo d4fb201d05 fix(server): node-fetchおよびgotを使う以前の実装に戻す
see #9710
2023-01-25 12:00:04 +09:00
syuilo da274cd458 update deps 2023-01-24 14:49:29 +09:00
syuilo 083fa53d9c update deps 2023-01-23 20:13:18 +09:00
syuilo a3aafa03ad update deps 2023-01-22 04:17:58 +09:00
syuilo b8afabde2c add commands for build with swc 2023-01-19 16:58:09 +09:00
CyberRex 6e2d7e9792
Use pnpm for package manager (#9531)
* Use pnpm for package manager

* Fix

* Change github workflow

* use pnpm in workflow

* fix

* Fix test (e2e/jest)

* Update Dockerfile for pnpm

* Exclude node_modules from file search on VSCode

* Update pnpm-lock.yaml

* Update pnpm-lock.yaml

* Move typescript from devDependencies to dependencies

* Fix Dockerfile

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-01-16 06:08:42 +09:00
syuilo cedb4267ba update deps 2023-01-15 09:19:02 +09:00
syuilo 68e65ed5df update mfm-js 2023-01-14 09:02:33 +09:00
syuilo 74910f8d70 Revert "perf: build backend with swc (#9463)"
This reverts commit 4579d02296.
2023-01-13 09:32:56 +09:00
파링 4579d02296
perf: build backend with swc (#9463)
* feat: build backend with swc

* fix: swc build target

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-01-12 21:05:45 +09:00
tamaina 978a9bbb3b
perf(backend): Use undici instead of node-fetch and got (#9459)
* Implement? HttpFetchService

* ✌️

* remove node-fetch

* fix

* refactor

* fix

* gateway timeout

* UndiciFetcherクラスを追加 (仮コミット, ビルドもstartもさせていない)

* fix

* add logger and fix url preview

* fix ip check

* enhance logger and error handling

* fix

* fix

* clean up

* Use custom fetcher for ApRequest / ApResolver

* bypassProxyはproxyBypassHostsに判断を委譲するように

* set maxRedirections (default 3, ApRequest/ApResolver: 0)

* fix comment

* handle error s3 upload

* add debug message

* no return await

* Revert "no return await"

This reverts commit b5b0dc58a342393d260492e3a6f58304372f53b2.

* reduce maxSockets

* apResolverのUndiciFetcherを廃止しapRequestのものを使う、 add ap logger

* Revert "apResolverのUndiciFetcherを廃止しapRequestのものを使う、 add ap logger"

This reverts commit 997243915c8e1f8472da64f607f88c36cb1d5cb4.

* add logger

* fix

* change logger name

* safe

* デフォルトでUser-Agentを設定
2023-01-12 21:03:02 +09:00