Coolest part of clickhouse is it’s ability to do ETL automagically.

It really is a super power.

Are you familiar with git pickaxe?

For example: git log -pS 'deletedvar'

Founder of Axolo here .

We made Axolo specifically for that, we believe pull requests (or merge requests in your case) should not take too long to be reviewed and you should be able to discuss them easily. Axolo creates a Slack pipeline to automatize conversations with the creator and assignees/reviewers.

I'm in favor of this. You can't ingest code that says "you cannot use this without attribution", put it through a bunch of if statements that strip the license, and then say it's "AI-generated". I don't care about most of our generic CRUD apps or the 15th rewrite of a sorting algorithm, but I do care about those smart enough to advance the field and come up with novel solutions. If we take away the incentive for attribution and recognition, people won't be as willing to share and we'll all be worse for it.

Like someone else said, there was a version of this where they asked people to opt-in and got community involvement. In true MS fashion, they just did it without asking and people are rightfully pissed.

If your hybrid is mandatory then you can expect to be back to full time 5 days in a years time approx.

The workaround for vanilla youtube-dl is to use it with aria2, with options like:

  --external-downloader aria2c                                                                                         
  --external-downloader-args "--continue --max-concurrent-downloads=3 --max-connection-per-server=3 --split 3 --min-split-size 1M"

(possibly in your config file)

Also, neither --format best nor --format bestvideo chooses the best encoding in all cases; they use bitrate as a heuristic for quality, and a less efficient codec can have higher bitrate but worse quality, resolution, or framerate. The workaround for this is specifying --format with an enumeration of every combination of codec, resolution, and framerate in preferred order, which goes like this:

  --format "(bestvideo[vcodec^=av01][height>=4320][fps>30]/bestvideo[vcodec^=vp9.2][height>=4320] ...

Here's a full example (hmm... they're using it with yt-dlp, which I thought had fixed this?):

https://github.com/TheFrenchGhosty/TheFrenchGhostys-Ultimate...

I think there's a bit of variation in the exact order among the config files found online. If you're goals are archival, consider also retrieving metadata, thumbnail, and subtitles in all languages; I also have in my config the options:

  --verbose
  --download-archive ./ytdl-archive.txt                                                                                                                       
  --cookies ./ytdl-cookies.txt   
  --merge-output-format mkv
  --add-metadata --all-subs --embed-subs                                                                                                          
  --write-info-json --write-thumbnail                                                                                                             
  --no-overwrites --continue                                                                                                                      
  --force-ipv4

(the only remaining workaround for age-restricted videos is to give it cookies extracted from a browser with a real Google account logged in)

If you find yt-dlp particularly slow, you can use aria2c to perform the download itself. It doesn't solve any startup latency problems, but it generally can do the HTTP requests faster.

This is not exactly the same thing, but for the love of god, if you have a monitoring or logging product, make the date and time zone visible wherever time is displayed. I cannot tell you how many times I've been sent screenshots of graphs, showing some catastrophic scenario at, say, 08:43, with no idea of what time zone the graphs are using, or what day the graph is showing.

Do apply for other jobs. It’s likely you’re working in a disfunctional place. However, if you decide to stick around do what you need to do to understand what is going on and don’t hide the fact that you need to get a better picture. If they fire you for that it’s a good confirmation you needen’t bother working there, the place is disfunctional.