Samantaz Fox
b5b0c58de7
Add missing translation for quality selectors
3 years ago
Samantaz Fox
a1bb421eec
Remove useless 'hl' parameters on captions URL
3 years ago
Samantaz Fox
139786b9ef
i18n: pass only the ISO code string to 'translate()'
...
Don't use the whole Hash everywhere.
Also fall back nicely to english string if no translation exists.
3 years ago
Samantaz Fox
301444563b
i18n: Use language full name instead of ISO code
...
Fixes #851
3 years ago
Samantaz Fox
9966c21c6b
i18n: Add list of language names
3 years ago
babababag
fd54cf2d05
Escape video description
3 years ago
Samantaz Fox
2c447a42f2
Make sure to only apply fix if QUIC is disabled
3 years ago
Samantaz Fox
dad8f9a0ce
Fix typo
...
Should be checking the returned headers, not the sent ones.
3 years ago
Samantaz Fox
2eac23a0b3
Temporary fix for #2612
...
Don't rely on the auto compression/decompression provided by the crystal stdlib.
3 years ago
Samantaz Fox
00904ae3f2
Merge pull request #2444 from syeopite/only-use-redirect-endpoint-when-needed
...
Only use the /redirect endpoint when automatically redirecting to another instance
3 years ago
Émilien Devos
d214a0b333
remove duplicate lsquic requirement
3 years ago
syeopite
a120f143d7
Disable quic by default
...
See #2577
3 years ago
syeopite
65fbdbff6a
Remove of gzip header w/ use_quic config
...
Continuation of b0f127d4d8
3 years ago
syeopite
6ec4dcfafd
Fix handling for maxres thumbnail
3 years ago
syeopite
48191aca6e
Fix copy-paste error
3 years ago
syeopite
83556bace2
Allow thumbnail queries with QUIC disabled
3 years ago
syeopite
814c9e6c3a
Use https for storyboard image requests
3 years ago
syeopite
547abe17d9
Use https for ggpht requests
3 years ago
syeopite
6b8450558d
Allow storyboard queries with QUIC disabled
3 years ago
syeopite
c3747c2d49
Allow ggpht queries with QUIC disabled
3 years ago
syeopite
245122104a
Respect use_quic param and fix typos
3 years ago
syeopite
b0f127d4d8
Fix gzip decompression with HTTP::Client
3 years ago
syeopite
d379a36c0e
Add compile-time flag to remove code for QUIC
3 years ago
Samantaz Fox
6cf0ff6b49
Remove useless auto_generated param from PlaylistVideo#to_xml
...
given the variables available in this function's context, 'author' and 'ucid'
provide the same data 'self.author' and 'self.ucid', respectively.
Given that fact, the variable `auto_generated` has no impact on the logic of
this function, and hence can be safely removed. this greatly simplifies the
code and makes it perfectly compatible with crystal's calling convention for
'#to_xml' methods.
3 years ago
Samantaz Fox
86f75758a7
Fix 'to_json' in struct PlaylistVideo
3 years ago
Samantaz Fox
0ec94405ce
Add TODO comments to other places
3 years ago
Samantaz Fox
33780f1995
Also fix 'to_json' in struct Video
3 years ago
Samantaz Fox
1cb715ac9f
serialized_yt_data: force datatype of 'locale'
3 years ago
Samantaz Fox
f65b628bf3
serialized_yt_data: Remove default nil value in to_json
...
this will ensure that two parameters are passed and that it
doesn't collide with 'to_json(builder)'
3 years ago
Samantaz Fox
60fa552469
Fix an infinite recursion caused by #2228
...
Changes in the aforementioned PR lead to change the behavior
of some old code.
The data type of the parameters aren't explicit enough, which
makes the compiler use the wrong method because of type infering.
3 years ago
syeopite
437bdedb07
Use env.request.resource for instance switch link
3 years ago
syeopite
a531f4f057
Rebase error
3 years ago
syeopite
bb396a310e
Remove unneeded redirect.invidious.io code in /redirect
3 years ago
syeopite
66e7285108
Only use /redirect when automatically redirecting
3 years ago
Samantaz Fox
2b81a82620
Merge pull request #2529 from DmitrySandalov/master
...
Feature Request: Localization for trending iv-org#331
3 years ago
Samantaz Fox
b555df8377
Merge pull request #2428 from syeopite/ameba-fixes
...
Fix (some) issues detected by Ameba
3 years ago
Samantaz Fox
232730e909
Merge branch 'master' into master
3 years ago
Samantaz Fox
1e0712625a
Normalize translation key for preferences categories
...
categories normalized:
- Miscellanous
- Player
- Visual
- Administrator
- Data
- Subscription
3 years ago
Samantaz Fox
88752f32bd
Normalize translation key for user prefrerences
...
preferences normalized:
- annotations
- annotations_subscribed
- automatic_instance_redirect
- autoplay
- captions
- comments
- continue
- continue_autoplay
- dark_mode
- default_home
- extend_desc
- feed_menu
- listen
- local
- locale
- max_results
- notifications_only
- player_style
- quality
- quality_dash
- related_videos
- show_nick
- sort
- speed
- thin_mode
- unseen_only
- video_loop
- volume
- vr_mode
3 years ago
syeopite
e2bbc9a6fa
Switch to #sort_by! in pull_popular_videos job
3 years ago
syeopite
17e481c107
Reduce block verbosity further
3 years ago
syeopite
b8f27a42a7
Optimize assigning of on_response_received_endpoints
3 years ago
syeopite
575c66efd3
Remove extra dot between [] from ambea copy-pasting.
3 years ago
syeopite
88ad7c8d8d
Update src/invidious/routes/playlists.cr
...
Co-authored-by: Samantaz Fox <coding@samantaz.fr>
3 years ago
syeopite
1adcac175e
Update src/invidious/routes/channels.cr
...
Co-authored-by: Samantaz Fox <coding@samantaz.fr>
3 years ago
syeopite
dd8c412abc
Fix Style/IsAFilter issues
3 years ago
syeopite
e969c1490a
Fix Performance/ChainedCallWithNoBang issues
3 years ago
syeopite
e91421253e
Fix Style/VerboseBlock issues
3 years ago
syeopite
35d15c7c2b
Fix Style/VariableNames issues
3 years ago
syeopite
20cb751ff6
Fix Lint/UnusedArgument issues
3 years ago
syeopite
0614b52f03
Fix Lint/RedundantStringCoercion issues
3 years ago
Dmitry Sandalov
a629521c37
Feature Request: Localization for trending (remove region from server config)
3 years ago
Dmitry Sandalov
0e17d026f2
Feature Request: Localization for trending (fix lint CONTENT_REGIONS end comma)
3 years ago
Dmitry Sandalov
1d78d67af3
Feature Request: Localization for trending (move TRENDING_REGIONS to i18n.cr as CONTENT_REGIONS)
3 years ago
Dmitry Sandalov
d9c58c4837
Feature Request: Localization for trending iv-org#331
3 years ago
syeopite
129779a757
Merge pull request #2433 from iv-org/increase-channel-refresh-delay
...
Decrease channel refresh frequency (1 min -> 1 h)
3 years ago
syeopite
c8a985cc77
Merge pull request #2477 from SamantazFox/move-prefs-and-config
...
Move user preferences and server config
3 years ago
Samantaz Fox
cb9b84f940
Move 'extract_text()' to 'extractors_utils.cr'
3 years ago
Samantaz Fox
33d9be0ffb
Move 'extractors.cr' to 'yt_backend' folder
3 years ago
Samantaz Fox
2571e420f3
Move 'add_yt_headers()' to 'connection_pool.cr'
3 years ago
Samantaz Fox
e17c8b1f4d
Move 'extract_videos' and 'extract_selected_tab' too
3 years ago
Samantaz Fox
8805ee7c8c
Add fetch_continuation_token back (required by #2215 )
3 years ago
Samantaz Fox
7df2fd0bc8
Add 'require' statement to 'invidious.cr'
3 years ago
Samantaz Fox
f7f0910953
Remove fetch_continuation_token(): dead code
3 years ago
Samantaz Fox
d300797e22
Move the YoutubeConnectionPool code to its own file
3 years ago
Samantaz Fox
56dbe15943
Move proxy & YoutubeAPI code to the yt_backend folder
3 years ago
syeopite
5f65e92500
Merge pull request #2508 from syeopite/lazy-load-images
...
Lazy load (some) images
3 years ago
syeopite
21b96a3159
Merge pull request #2506 from syeopite/handle-empty-playlist-tabs
...
Handle YT tabs without content
3 years ago
syeopite
888c7e2c29
Merge pull request #2491 from syeopite/extract-image-routes
...
Extract image routes
3 years ago
TheFrenchGhosty
22e8f7e287
Fix #2510
3 years ago
TheFrenchGhosty
0ad2793b68
Link to invidious.io/donate/ in the footer
3 years ago
syeopite
585e4617e8
Lazy load (some) images
3 years ago
syeopite
4d44b2c3a4
Handle YT tabs without any content
3 years ago
syeopite
b49b5fbda9
Support empty categories
3 years ago
syeopite
17e6093abb
Merge pull request #2497 from Yetangitu/videorendererparser_parse_missing_title
...
Handle missing title fields in VideoRendererParser.parse (fixes #2495 )
3 years ago
Frank de Lange
3dc980e800
Fix for #2488 - parse contents of search results of type=Category ( #2496 )
...
* Fix for #2488 - parse contents of search results of type=Category (returned on first page for universal (type=all) queries instead of returning an error.
* Moved content array walker to Category#to_json
As requested by reviewer this change moves the content array walker from the API endpoint to the Category class.
* Update src/invidious/helpers/serialized_yt_data.cr
Co-authored-by: syeopite <70992037+syeopite@users.noreply.github.com>
3 years ago
Frank de Lange
c44c1003af
Handle missing title fields in VideoRendererParser.parse
3 years ago
Samantaz Fox
678b10dbcf
Lookback 50 videos
3 years ago
diogo
a1d6411f1f
propagate video_id field on getting playlists
3 years ago
diogo
c4c8a10507
rename from continuation to video_id on get_playlist_videos
3 years ago
diogo
ee94ccdeb0
update to new YoutubeAPI
3 years ago
diogo
e3df9f9ead
use dig for getting the video index
3 years ago
diogo
62dc629337
linting
3 years ago
diogo
dccdf38ce7
increase the max videos in a playlist
3 years ago
diogo
84124b837d
use v1/next instead of searching for the continuation index
3 years ago
diogo
6176da3cbb
linting
3 years ago
diogo
24bc3e2704
no need to normalize the offset
3 years ago
diogo
0a9e19646a
pass the api/v1/playlists with videos before the offset
3 years ago
diogo
65e45c4079
linting
3 years ago
diogo
440105976f
fix cases when high offset video from playlist has no offset in url
3 years ago
diogo
7eba7fbcc7
add index to playlist item
3 years ago
diogo
d9bfb3d305
playlist starts at the offset
3 years ago
syeopite
4246c7a523
Extract image routes
3 years ago
Samantaz Fox
57ed047025
Add mising 'require' statement to 'invidious.cr'
3 years ago
Samantaz Fox
bda3a26423
Move server structure to a separate file
3 years ago
Samantaz Fox
080d9a8dc7
move theme converter function to a separate file
3 years ago
Samantaz Fox
984a4acc7b
Move user preferences structure to a separate file
3 years ago
syeopite
b10f37bea9
Use kemal in production mode ( #2455 )
3 years ago
mastihios
0947c26612
Fix URL-encoding in href strings ( #2460 )
...
* hrefs: replace HTML.escape w/ URI.encode_www_form
* Fix search_query_encoded
3 years ago
Samantaz Fox
c6f088d6ca
Reduce refresh delay, increase backoff start duration
3 years ago
syeopite
21e29411af
Fix extractor bugs ( #2454 )
...
* Add debug/trace logging to extract_items
* Handle invalid timestamps for livestreams extraction
* Make use of author_fallback in playlist extractor
* Don't use extract_text for video length extraction
The extract_text function attempts to extract from both the simpleText and
the runs route. This is typically what we'd want for text extraction as
it could appear in both locations. However, while this still holds true,
the thumbnailOverlayTimeStatusRenderer writes a numerical length (when
present on the video) to the simpleText route and uses runs for a
text overlay like "LIVE" or "PREMIERE".
Therefore, when a video has a text overlay instead of a numerical one,
Invidious still passes it onto decode_length_seconds, which obviously
raises since it cannot be converted into integers.
In the future, if more routes requires one text route over the other, we
should go ahead and add an argument to extract_text itself. Though for
now, this is sufficient.
* Handle unsupported "special" categories
3 years ago
Samantaz Fox
adc12addfa
Add config option to display source code URL in footer ( #2450 )
3 years ago
Samantaz Fox
d806310665
Revert "Fix typo ( #2456 )" ( #2457 )
...
This reverts commit 4982bff74d
.
3 years ago
Jorge Maldonado Ventura
4982bff74d
Fix typo ( #2456 )
3 years ago
syeopite
81b12b8001
Add support to make invidious API-only via flag ( #2363 )
3 years ago
syeopite
3e781b7d13
Merge pull request #2443 from iv-org/syeopite-patch-1
...
Use make_client when querying instance api
3 years ago
syeopite
9c44e41a4c
Merge pull request #2228 from syeopite/extract-items-overhaul
...
Overhaul extract_item(s) functions and add infrastructure for parsing YouTube categories
3 years ago
syeopite
73eabb6ca2
Actually fix lint
3 years ago
Samantaz Fox
5a52b4fe45
Fix lint
3 years ago
Samantaz Fox
caa08a6379
Disable locales with less than 50% of strings translated
3 years ago
Samantaz Fox
cd02078e26
Add Portuguese (pt) to locales
...
follow up to #2437
3 years ago
syeopite
77131cff91
Use make_client when querying instance api
3 years ago
mastihios
7b2aa5f98e
add icon-buttons to playlist items ( #2442 )
3 years ago
syeopite
26b28cea49
Use break instead of short-circuit return
3 years ago
syeopite
23049e026f
Improve readabltiy of SearchChannel auto-gen detect
3 years ago
syeopite
9ab242ca2e
Optimize routing logic of extract_item(s) funcs
3 years ago
syeopite
aa59925374
Rename get_browse_endpoint to get_browse_id
3 years ago
syeopite
43ea8fa706
Convert nil for AuthorFallback to empty strings
3 years ago
syeopite
6df85718e6
Apply suggestions from code review
...
Co-authored-by: Samantaz Fox <coding@samantaz.fr>
3 years ago
Samantaz Fox
9ba3e1cdb4
Decrease channel refresh frequency (1 min -> 1 h)
...
This is a temporary fix to reduce load on instances with many channels and avoid IP being flagged by Google.
3 years ago
syeopite
b20f72b963
Use default timeout (5 seconds) for YT pool ( #2430 )
3 years ago
syeopite
092b8a4e52
Add documentation to extractors.cr
3 years ago
syeopite
e5f07dedbf
Typos and tiny styling changes
3 years ago
syeopite
ca9eb0d539
Bountiful extractor changes
...
- Add extract_text to simplify extraction of InnerTube texts
- Add helper extractor methods to reduce repetition in parsing InnerTube
- Change [] more than 2 blocks long to use #dig or #dig?
- Remove useless ?.try blocks for items that always exists
- Add (some) documentation to VideoRendererParser
3 years ago
syeopite
142317c2be
Overhaul extractors.cr to use modules
3 years ago
syeopite
3dea670091
Switch to structs in extractors.cr for performance
3 years ago
syeopite
8435e79913
Improve documentation for extract_item(s) funcs
3 years ago
syeopite
30e85b40f9
Fix extract_videos
3 years ago
syeopite
be1a43a337
Manually extract category refactor from 1b569bbc99
...
Also fixes some errors caused by cherry-picking
3 years ago
syeopite
abca8f7a7c
Rename invidiousitems.cr
3 years ago
syeopite
7b60dac526
Add description_html field to Category
...
(cherry picked from commit aa8f15f795
)
3 years ago
syeopite
ea6434662d
Change typing of Category contents to only Array
...
(cherry picked from commit d3384e17f1
)
3 years ago
syeopite
0b7a108a59
Move continuation_token out of Category struct
...
(cherry picked from commit 0e96eda28f
)
3 years ago
syeopite
57c63f3598
Rename "items_without_cate_items" to reflect usage
3 years ago
syeopite
ae30f32c36
Unpack search items that are embedded in categories
...
This is a squash of a bunch of commits
cherry-picked commits
Fix category parse error on search
(cherry picked from commit cc02fed4e6
)
Fix category items not being extracted in search
(cherry picked from commit 2605b9c609
)
Make search not include category items for now
(cherry picked from commit ca4afd59f4
)
Change behavior of categories in search results
(cherry picked from commit cc10675610
)
Fix missing search results in extraction
(cherry picked from commit abda6840d5
)
Fix miscount of search results
(cherry picked from commit 491e33450e
)
3 years ago
syeopite
a50f64f6e9
Add parser for categories (shelfRenderer)
...
This commit adds a new parser for YT's shelfRenderers which are
typically used to denote different categories.The code for featured
channels parsing has also been moved to use the new parser but some
additional refactoring are needed there.
The ContinuationExtractor has also been improved and is now capable of
extraction continuation data that is packaged under
"appendContinuationItemsAction"
In additional this commit adds some useful helper functions to extract
the current selected tab the continuation token. This is to mainly
reduce code size and repetition.
--
This cherry-picked commit also removes the code for parsing featured
channels present on the original.
(cherry picked from commit 8000d538db
)
3 years ago
syeopite
1323b94b7a
Rewrite extract_item and extract_items functions
...
This commit completely rewrites the extract_item and extract_items
function. Before this commit these two function were an unreadable
mess. The extract_item function was a lengthy if-elsif chain
while the extract_items function contained an incomprehensible
mess of .try, else and ||.
With this commit both of these functions have been pulled into a
separate file with the internal logic being moved to a few classes.
This significantly reduces the size of these two methods, enhances
readability and makes adding new extraction/parse rules much simpler.
See diff for details.
--
This cherry-picked commit also removes the code for parsing featured
channels present on the original.
(cherry picked from commit a027fbf7af
)
3 years ago
syeopite
6d68fbc31d
Fix livestream regex regression caused by #2271
...
Closes #2352
Special thanks to @WaywardHeart for finding this issue!
3 years ago
syeopite
86ca568d6d
Remove login type button from frontend ( #2423 )
3 years ago
Walkyst
2b0bb69a4f
Fix mixes route ( #2421 )
3 years ago
syeopite
87f46a7532
Unregister captcha job ( #2390 )
3 years ago
Samantaz Fox
e655af251c
Try not to log search queries ( #2362 )
3 years ago
syeopite
5054510d15
Prevent VR from being initialized in listen mode ( #2396 )
3 years ago
Samantaz Fox
947fe4fbb3
HTML escape video mimetype
...
Video mimetype may contain code information between double quotes.
If not properly escaped, it breaks the browser's parser. E.g:
```
type="video/mp4; codecs=" avc1.64001f,="" mp4a.40.2""=""
```
Thank Robin for catching this!
3 years ago
syeopite
50c8afb525
Handle equirectangular projections for VR ( #2379 )
3 years ago
syeopite
a539de4f97
Bump dependencies ( #2378 )
...
* Upgrade to Kemal v1.1.0
* Bump postgres driver
3 years ago
TheFrenchGhosty
8d5a867271
Merge pull request #2380 from syeopite/fix-invidious-showing-yt-redirect-links
...
Fix invidious showing yt redirect links
3 years ago
syeopite
387bddb51b
Improve detection and handling of yt redirect links
3 years ago
Emilien Devos
41ba19b615
fix comment replies
3 years ago
syeopite
a28945273d
Propagate replacing yout.be links to /watch to RSS
3 years ago