Commit Graph

1044 Commits (c713c32cebda5d0199b5c0dd553744f8d61707da)

Author SHA1 Message Date
Samantaz Fox a6c9b263da
DB: don't pass PG_DB to check_table/check_enum 3 years ago
Samantaz Fox eff8b23f57
Improve youtube import type detection
Code courtesy of bbielsa:
https://gist.github.com/bbielsa/7d131aa2188945f591a8379ec0defc9b
3 years ago
bbielsa 8d47ec714e
Add text/xml as a possible mime type for xml file uploads 3 years ago
bbielsa 9607fe03af
Detect the type of subscription import format based on the content type of the file uploaded 3 years ago
bbielsa 43ff3be751
Test if body content is likely JSON, if so parse the json format of subscriptions export. If the content is anything else, assume it is CSV and parse 3 years ago
Samantaz Fox d74873fed1
Clean useless database arguments (4/5) 3 years ago
Samantaz Fox 40ed4a0506
Clean useless database arguments (3/5) 3 years ago
Samantaz Fox c25d664edc
Clean useless database arguments (2/5) 3 years ago
Samantaz Fox 9bad7e2940
Clean useless database arguments (1/5) 3 years ago
Samantaz Fox 6704ce3214
Move DB utility functions to the proper module 3 years ago
Samantaz Fox 85cf27119c
Move DB queries related to playlists in a separate module (3/3) 3 years ago
Samantaz Fox 7691f53520
Move DB queries related to 'users' in a separate module (2/2) 3 years ago
Samantaz Fox 094f835642
Move DB queries related to 'users' in a separate module (1/2) 3 years ago
Samantaz Fox 92eea3b18b
Move DB queries related to session tokens in a separate module 3 years ago
Samantaz Fox c021b93b5c
Move DB queries related to channels in a separate module 3 years ago
Samantaz Fox 46d08237c6
Move DB queries related to playlists in a separate module (2/3) 3 years ago
Samantaz Fox 3deafe9f8d
Move DB queries related to playlists in a separate module (1/3) 3 years ago
Samantaz Fox 998edba6f0
Move DB queries related to 'videos' in a separate module 3 years ago
Samantaz Fox 139786b9ef
i18n: pass only the ISO code string to 'translate()'
Don't use the whole Hash everywhere.
Also fall back nicely to english string if no translation exists.
3 years ago
syeopite e91421253e
Fix Style/VerboseBlock issues 3 years ago
syeopite 35d15c7c2b
Fix Style/VariableNames issues 3 years ago
syeopite 20cb751ff6
Fix Lint/UnusedArgument issues 3 years ago
syeopite c8a985cc77
Merge pull request #2477 from SamantazFox/move-prefs-and-config
Move user preferences and server config
3 years ago
Samantaz Fox 7df2fd0bc8
Add 'require' statement to 'invidious.cr' 3 years ago
syeopite 4246c7a523
Extract image routes 3 years ago
Samantaz Fox 57ed047025
Add mising 'require' statement to 'invidious.cr' 3 years ago
syeopite b10f37bea9
Use kemal in production mode (#2455) 3 years ago
syeopite 81b12b8001
Add support to make invidious API-only via flag (#2363) 3 years ago
syeopite b20f72b963
Use default timeout (5 seconds) for YT pool (#2430) 3 years ago
syeopite 87f46a7532
Unregister captcha job (#2390) 3 years ago
syeopite 4a0359c04e
Pass success msg from dep script during compile-time 3 years ago
syeopite 06a1d2ac41
Rename fetch_videojs* to fetch_player* 3 years ago
syeopite a539de4f97
Bump dependencies (#2378)
* Upgrade to Kemal v1.1.0

* Bump postgres driver
3 years ago
syeopite 4fcd0964cd
Extract API routes (#2271)
* Extract API routes from invidious.cr
* Remove deprecated APIs
  - insights
  - top feed
3 years ago
syeopite 5005212bec
Extract feed routes (#2269)
* Extract feed routes from invidious.cr
* Removes the deprecated route for /feed/top
* Deprecate /view_all_playlist & use /feed/playlists
* Move feed views into their own directory

* Add haltf method to halt current route context
* Change status_code + return blocks to use haltf

* Set appropriate response headers for RSS routes
3 years ago
Émilien Devos a279d6f433
Fix livestream parsing URLs (#2356) 3 years ago
syeopite fceb8093f1
Use `athena-negotiation` to detect language through Accept-Language header (#2324)
Detect language through Accept-Language header
3 years ago
syeopite 39b34eece8
Extract API routes from invidious.cr (3/3)
- Auth (excluding notifications*) APIs
- Mixes

*Notifications currently require the "connection_channel" channel
for talking with the notifications job. Unfortunately, we cannot
access that within the route modules yet.
3 years ago
syeopite 6aa65593ef
Extract API routes from invidious.cr (2/?)
- Video playback endpoints
- Search feed api
- Video info api
3 years ago
syeopite cbf3d75087
Extract API routes from invidious.cr (1/?) 3 years ago
syeopite 0b0036813f
Remove deprecated APIs
- insights
- top feed
3 years ago
Émilien Devos 12b46bbd41
switch to innertube API for about channels (#2255) 3 years ago
Émilien Devos 88c5e3b6fa
Use the new youtube api for comments (#2217)
* use the new youtube api for comments
* remove PG_DB & action parameter + allow force region
* support new comments data with onResponseReceivedEndpoints
3 years ago
syeopite 1321c90920
Extract channel routes (#2227)
* Extract primary channel routes from invidious.cr

Also removes timedtext_video stub since all it does is redirect to the
homepage. However, Invidious's 404 handler already does this.

--
As the template for the channel about page doesn't exist yet, the
behavior for the /channel/:ucid/about endpoint has been changed to be
the same as what's currently present on Invidious

(cherry picked from commit 8fad19d805)

* Manually extract brand_redirect from 1b569bbc99

This commit manually extracts the brand_redirect function from the
commit mentioned.

However, the redirect to the  `.../about` endpoint is removed due to the
fact that it doesn't exist yet.

This commit is also mainly just a bridge for the next few cherry picks from
\#2215

* Update brand_redirect to use youtubei resolve_url

(cherry picked from commit 53335fe7cf)

* Add additional channel endpoints to brand_redirect

(cherry picked from commit 8fc6f3add6)

* Add separate handler for /profile endpoint

* Add /channel/:ucid/home route

* Document all channel brand_urls
3 years ago
syeopite 3e5c353298
Merge pull request #2205 from syeopite/fix-age-restricted-videos
Partial (and temporary) fix for age restricted videos
3 years ago
syeopite ae61662f61
Debloat channels.cr into multiple files (#2225)
Cherry picked from ui overhaul branch with a few modifications:
  - channel folder is renamed to channels
  - parsing for channel home and featured channels are removed due to
    lack of infrastructure from other commits

(cherry picked from commit 44d18b8e14)
3 years ago
syeopite 54b19a04bb
Fix caption parsing on age restricted videos 4 years ago
Samantaz Fox 5a8825d016
Fix quoting of 'none' in CSP header
The keyword 'none' must be surrounded by single quotes.
Regression introduced by #2168.
4 years ago
syeopite 31fa3dfd59
Add route to redirect to another instance 4 years ago
TheFrenchGhosty b8f0b4b583
Typo 4 years ago
Samantaz Fox 42d9fd9c88 Rewrite response headers
Fixes #2018 and #2153
4 years ago
syeopite 0a87ba6930
Decode URL encoded preference cookie when parsing 4 years ago
syeopite 065c104f27
Upgrade to crystal 1.0.0 4 years ago
Samantaz Fox cac5f20a28 Move locales definition to i18n.cr 4 years ago
Andrew Zhao 9a8f1a0b0a add option to disable quic 4 years ago
syeopite 877bb5c821
Add aliases for watch route 4 years ago
Svallinn cbdba66ef3
Use the youtubei API over the legacy one 4 years ago
Andrew Zhao 89fd35e02d fix comment replies 4 years ago
Svallinn fa050fb8a8
Fix: functional hl / dark_mode / thin_mode params 4 years ago
TheFrenchGhosty 3cc9114f81
Merge pull request #1829 from SimonPhoenix96/xml-json-yt-sub-import
integrate legacy yt xml subscription import with new json sub import
4 years ago
Perflyst fc8c555519
Merge pull request #1729 from Rjevski/12factor-database-url-restored
Support "Database URL" in addition to existing DB-related parameters
4 years ago
simonphoenix96 84487b2e52 format invidious.cr using crystal cli 4 years ago
Simon Phoenix 9689376de6
fixed line indent typo 4 years ago
simonphoenix96 a2f79a163f integrate legacy yt xml subscription import with new json sub import 4 years ago
Andrew Zhao 2600695927 fix search
Put search page in the super secret proto field
4 years ago
TheFrenchGhosty c451aab150
Enable the Hebrew translation since it's now translated at more than 80% 4 years ago
TheFrenchGhosty 48bff9a5d2
Enable the Indonesian translation since it's now translated at more than 80% 4 years ago
saltycrys 5f03a583d1 Update code for Crystal 0.36.0
Rename `HTTPClient@socket` to `HTTPClient@io`, see
https://github.com/crystal-lang/crystal/pull/9543.

Rename `URI#full_path` to `URI#request_target`, see
https://github.com/crystal-lang/crystal/pull/10099.
4 years ago
saltycrys 991a04dc2a Adjust routes
Simple routes have been moved into a single `Misc` file.

Embed routes have been moved into a single `Embed` file.

The preferences route has been renamed to be more consistent with other parts
of the codebase.
4 years ago
Perflyst 82da5cfd01
Merge pull request #1712 from tenpura-shrimp/bumpvideojs
Bump videojs and fix webworker
4 years ago
Andre Borie 79e99908de Allow providing 12-Factor-style Database URL in config 4 years ago
TheFrenchGhosty bd893cb24c Enable the Finish translation since it's now translated at more than 80% 4 years ago
saltycrys c9a316ad35
Merge pull request #1702 from saltycrys/config
Config improvements
4 years ago
Andrew Zhao 4a0b10984a Bump videojs and fix webworker 4 years ago
saltycrys 70e14f92a4 Only start refresh jobs when necessary
If `channel_threads` or `feed_threads` is set to zero the corresponding job is
now not started.
4 years ago
saltycrys b45f371911 Make config a constant
Instead of passing around `config` there is now the global `CONFIG`.
4 years ago
saltycrys f1a7ee997b Add config environment variables
The config file can now be specified with `INVIDIOUS_CONFIG_FILE`.
A YAML formatted string can still be passed with `INVIDIOUS_CONFIG`, replacing
the config file.

Additionally all options can now be specified as environment variables.
The syntax for variable names is `INVIDIOUS_` followed by the option name in
upper case. The values are parsed as YAML.

These new env vars only update the provided main configuration, but it is
possible to point the config file at the example config and then use env vars
for all config options:
```
INVIDIOUS_CONFIG_FILE=./config/config.example.yml \
INVIDIOUS_CHANNEL_THREADS=10 \
./invidious
```
4 years ago
TheFrenchGhosty 799f97e847 Make invidious use all the translation files 4 years ago
Andrew Zhao b7fe1db89a save host when using dash manifest 4 years ago
saltycrys c81ca187f8 Fix downloads
The `itag` is now converted to a number, matching the `itag` of
`Video.adaptive_fmts` and `Video.fmt_stream`.
4 years ago
saltycrys b0b8ba7000 Respect `use_pubsub_feeds` config
Setting `use_pubsub_feeds: false` now properly disables it.
4 years ago
saltycrys 6365ee7487 Make logger a constant
Instead of passing around `logger` there is now the global `LOGGER`.
4 years ago
saltycrys 7a8620a570 Add CLI arguments to config file
The log level can now be set with `log_level` (accepts ints and strings).
The log file can now be set with `output` (also accepts `STDOUT`).
4 years ago
Perflyst 2c24bf3222
Merge pull request #1389 from vhuynh3000/decrypt_on_demand
add config to decrypt on demand instead of polling
4 years ago
saltycrys 36e9fb9d68 Fix `watch_videos` endpoint
Playlists created by `watch_videos` do not have an author which caused a crash
previously.
4 years ago
vhuynh3000 3a2bd4e928 add config to decrypt on demand instead of polling 4 years ago
Perflyst c89632d2a8
Merge pull request #1608 from saltycrys/add-subscription-traces
Add Subscription Traces
4 years ago
TheFrenchGhosty 82c8f3b556
Merge pull request #1600 from jksladjflkjsadflkjsadf/closeclients
Close http clients after use
4 years ago
Perflyst b19524d56a
Merge pull request #1609 from saltycrys/add-popular-enabled-option
Add `popular-enabled` option
4 years ago
Andrew Zhao e0d25ff887 Close http clients after using
The crystal http client maintains a keepalive connection to the other
server which stays alive for some time. This should be closed if the
client instance is not used again to avoid hogging resources
4 years ago
saltycrys 198dfffaeb Add `popular-enabled` option
This is similar to the removed `top-enabled` option but for the Popular feed.
The instance needs to be restarted if the feed was enabled.

Editing admin options on the preferences page is also fixed.

The handling of the feed pages now only happens in a single place.

Instead of redirecting:
  - The Top feed now displays a message that it was removed from Invidious.
  - The Popular feed now displays a message that it was disabled if it was.
4 years ago
saltycrys c4ef055248 Add RefreshChannelsJob traces
Traces can be enabled with `-l trace`.

The problem with subscriptions is that sometimes requests to YouTube never
finish. As soon as that happens `channel-threads` times subscriptions stop
being refreshed. This is most likely a problem with the lsquick bindings.
4 years ago
Perflyst 8df591e8d4
Merge pull request #1595 from saltycrys/improve-storyboards
Improve storyboards
4 years ago
saltycrys 75c6844b66 Improve storyboards
Instead of limiting the width of storyboards through CSS it is now done in the
VTT directly.
4 years ago
saltycrys b39f01dcdf Improve logging
Everything that gets logged now has a log level associated with it.

The log level can be set with the new `-l` or `--log-level` arguments.

The defaul log level is `debug` for now. There aren't many things that get
logged but if the logs get spammed in the future it can be set down to `info`.
4 years ago
Matthew McGarvey fb06482916 Extract out User Preferences endpoints 4 years ago
Amanda Graven 848add1b1b
Set channel thumbnail as icon for feeds (#1106) 4 years ago
Matthew McGarvey 2dacdf0210 Extract login/signout routes from global file 4 years ago
Andrew Zhao 0cb442d40e do not proxy hls on supported browser 4 years ago
Lukas 62e8c09183 Fix YouTube subscription import parser 4 years ago