On Fri, 17 Jun 2022 04:30:52 +0200, Sasi Olin wrote:
I am not touching the rest of the forums, since we will not need it for discourse migration anyway. Should we schedule maintenance for the forums and fix them using those? What I would essentially do would be: 1. Dump the entire database into utf8 charset (essentially intentionally breaking it with mysqldump --set-charset=utf8 > ...) 2. Dump the bits of the database with latin1 encoding using the queries above (with mysqldump --set-charset=latin1 --single-transaction=TRUE \ --where="$query_after_where" $database $table > ...) 3. Import the big dump into a new database 4. Override the broken database bits with the small dumps
It seems like the least potential for breakage this way, since all of those seem properly indexed but I am open to suggestions.
There are some older and newer posts with broken encoding, because a lot of people were using utf8 with nntp before the switch and some people kept using signatures with broken encoding past the utf8 switch. We can keep around the old database and fix the posts one by one, but people did reference broken posts in the forums themselves as well, so it would be breaking the actual flow of the conversations at that point.
Coming back to this discussion - it looks like the test environment has been offline for a while (I've noticed a 502 Gateway error for > 1 month now). We're having a discussion inside the forums admin/mod team about how we might move this forward without worrying about migrating the existing content - in the interests of making some progress. But I think it would also inform our discussion to know if anything more has happened with the database migration - and if there's a way for us to get back into the sandbox system to see what structure was able to be built out (I know Discourse only allows categories and sub-categories, but no further levels of sub-categories can be created, which means 2 levels rather than 3, as we have now). Jim -- Jim Henderson Please keep on-topic replies on the list so everyone benefits