I'm using some public APIs that GOG is exposing to the internet, typically to work with Galaxy, in order to painstakingly check all the product ids in the range of 0 up to 2.1+ billion. Every game on GOG has one of these ids associated - how they are allocated no one knows, and to my knowledge no one has ever checked every id one by one.

The possibility to find yet unreleased games is slim however, as GOG has already implemented a means of hiding such ids (they basically won't return anything publicly). Slim, but not zero, however, because in some cases GOG forgets to hide everything that needs to be hidden.

They do tend to react quickly though, for example the ids I've singled out for "Deserts of Kharak" no longer return anything - ergo one of the blues hid them after I shared the links on this forum.
I can't see any not announced/released games unless GOG forgets to hide them. There's an "is_secret" flag that controls his behavior for each entry and most of the really interesting stuff is already no longer publicly accessible.
In essence, you're right, but it's not what I am doing at the moment. SCPM has a nice way of doing just that, and I may also be on the lookout in the future, however right now I'm mapping the entire id range by doing incremental queries of 50 ids at a time and saving the response. Got up to 1.5 billion from 0 so far, but still have ways to go.

New releases may well fly right past me at this point.

Hmmm, well maybe it's worth checking even beyond 2.1 billion after all :)... http://api.gog.com/products?ids=2130376219

Well as the ids do seem to be randomly assigned by monkeys then you might as well keep going :)

I've got no clue as to what this might be for: http://api.gog.com/products?ids=1589615681

Any ideas? Maybe just a test entry for THQ Nordic? :)

Got up to about 1.75 billion ids and I'm still going, at what seems to be a jet-propelled snail pace of ~5000 ids per second. Any interesting stuff I'll find (and there have been some picks here and there), I'll post in this thread.

The data dump I'm gathering looks pretty extensive now, but I gotta tell you it's a messy and sometimes funny place. I'll share all of it when it's done, as I've said before, but here's a small sample of what is to come, like huehuehue... the game :): http://api.gog.com/products?ids=1207660033

Yeah, please delete it. Wouldn't want anyone to see that, right? :P

I mean GOG employs serious people, not blokes that would train monkeys to assign game ids.

Why the hate for octal numbers, though? :(

That is (literally) hilarious!

Ok, looks like GOG is not too excited about what I'm doing and they seem to have filtered out my IP in the REST API returns, since now, for all queries that I'm submitting, on mapped ids and unmapped ids, I'm getting the same response payload: "html".

I'm curious if this has ever happened to anyone before...

I've already confirmed everything works as expected with a proxy.

Seems like I will have to rethink what I'm doing and if I can continue doing it - I don't want to cause issues for anyone, in the end I was only using the public APIs they are exposing to query for entries they are not hiding.

*Sigh*

Try again tomorrow or in a few hours, as it could be an automated ban for exceeding a certain number of queries in a short time. MaGog also ran into this limitation for some other API.

Hmmm, ok, thanks, will do. Perhaps it is as you say, but it still strikes me as very odd. I haven't changed anything in my code for at least a week (definitely not altering the query submission rate) and this has never happened before...

You're probably right, though. You should maybe try asking Johny. whether they have actively blocked or not.

On second though, after some testing, I think you're the one that's right - it looks more like an automated blocking process. Turns out I'm also getting HTTP 400 Bad Request as a response code, but only noticed this now.

It may be something new they put in place because of my scans *double sigh*. Anyway, I'll retry after a while and try to throttle down my queries to appease the ever-restrictive and blocking GOG overlords.

This is getting ridiculous. Even at a rate of 1 request per second, my queries still get blocked. I sincerely hope this whole thing is a temporary API glitch.

I'll stop wasting any more time right now and will give it another go tomorrow.

The MaGog IP block I mentioned above used to last for 18 hours, so maybe you're still being blocked by GOG. Don't despair and try it again tomorrow. :)

Oh man, that's kinda harsh! Ok, I'll give it a rest for a while :).

Well, I'm still getting blocked it seems :|. Will let you know if the situation changes, but now I'm stuck in a rut at around 1.95 billion ids.