Commit Graph

1855 Commits

Author SHA1 Message Date
d9ffe8a1b6 OAPI: regenerate code 2024-02-29 20:38:38 +01:00
0c7bf3bf3b OAPI: add farm status service
Add an OpenAPI operation to fetch the overall farm status from the Manager.
2024-02-29 20:27:44 +01:00
94bf65a9e3 Bumped version to 3.5-alpha1 2024-02-26 18:17:19 +01:00
6162d280f1 Website: Bump available experimental version to 3.5-alpha0 2024-02-26 18:14:40 +01:00
81968610ed Worker: blender-render command, make the blendfile parameter optional
Only include the `blendfile` parameter if it is not empty. This makes it
possible to pass a Python script that loads/constructs the blend file,
instead of loading one directly.
2024-02-25 23:09:11 +01:00
72d5cfa07c Job compiler: test simplification of frame range for video task 2024-02-24 11:57:52 +01:00
Emmanuel Durand
1ffe0a10bd Job compiler: simplify output video name on rendering list of frames
When a more complex list of frames is to be rendered (like `1, 4, 5, 10,
15`), simplify the video filename to `{first}-{last}`.

Before: `somename-1, 4, 5, 10, 15.mp4`
Now:    `somename-1-15.mp4`
2024-02-24 11:57:46 +01:00
5b17fb24fd Website: clarify the worker configuration files
Add a little intro that explains that there are multiple config files. And
add a section that explains that the worker-specific files are not to be
edited, just deleted.
2024-02-22 13:05:22 +01:00
99062d42ac Website: add draft documentation for failure handling
The documentation isn't complete yet, I want to have a nice flow diagram
in there as well. But it's a start.
2024-02-22 13:00:24 +01:00
dfdb8e82a1 Worker: Refer to website instead of non-existent example file
The worker-written config files would all refer to
`flamenco-worker-example.yaml`, even though this file doesn't even
exist. Instead, the configuration file will refer to the appropriate
documentation on the website, and the credentials file will explain what
happens when you delete it.

The credentials are otherwise intentionally left undocumented, as their
contents are not to be manually edited. The only thing to do with that
file is delete it so that the Worker re-registers itself at startup.
2024-02-22 12:46:13 +01:00
7033028a0b Worker: use explicit type when writing config file
Instead of passing an arbitrary string ("Configuration" or "Credentials"),
use an explicit type for this. This will make it possible to have the
config-writing functions behave slightly differently depending on which
configuration type is being written.

No functional changes.
2024-02-22 12:46:13 +01:00
12bfa82854 Manager: add lifecycle events to the event bus
Send events on Manager startup & shutdown. To make this possible, events
sent to MQTT are now queued up until an MQTT server can be reached.
Otherwise the startup event would be sent before the MQTT connection was
established.
2024-02-21 22:20:56 +01:00
fd9605583f OAPI: regenerate code 2024-02-21 22:16:23 +01:00
a137ecd3cd OAPI: add lifecycle events
Add events for manager-startup and manager-shutdown.
2024-02-21 22:12:43 +01:00
e7bd8dff8a Bump Go version to 1.22 2024-02-21 21:23:08 +01:00
17c92e18c7 Website: adjust documentation for the new event bus
Needs more work though. At least now it doesn't point to non-existing
files any more.
2024-02-05 09:27:06 +01:00
e7c4285ac6 Manager: Adjust code for renaming SocketIO... types to Event...
No functional changes, just adjusting to the OpenAPI renames.
2024-02-05 09:25:43 +01:00
1ed893fa84 OAPI: regenerate code 2024-02-05 09:14:31 +01:00
441079aa06 OAPI: rename SocketIOxxx types to Eventxxx types
Events were previously only sent via SocketIO, but now they can also be
sent via MQTT. These are now renamed from `SocketIO…` to `Event…`.

There is still the SocketIO subscription mechanism, for which the types are
still prefixed with `SocketIO`. MQTT manages subscription on the broker,
not on Flamenco Manager itself, for now this will remain SocketIO-only
functionality.
2024-02-05 09:11:13 +01:00
3326f683da Manager: consistent MQTT server/broker naming
Consistently log about the MQTT "broker", not the "server". The former
is common MQTT terminology.
2024-02-04 18:28:12 +01:00
91d15df765 Manager Cleanup: consistent variable name for MQTTClient receiver pointer
No functional changes.
2024-02-04 17:03:38 +01:00
44bfe58891 Manager: friendlier log message when MQTT server connection cannot be made 2024-02-04 16:32:36 +01:00
f0c7acd903 Manager: fix web interface not showing last-rendered images on job view
Fix SocketIO subscriptions so that the client also subscribes to
job-specific last-rendered images whenever subscribing to job-specific
events. These are sent to another event topic, and thus need some extra
care. Before the introduction of the generic event bus, both message types
were sent to the same topic, but that's not supported by MQTT, and so things
had to change.
2024-02-04 16:12:16 +01:00
4f804958e5 Manager: add unittest for eventbus topics
The code was doing its work just fine, but I wanted to be sure.
2024-02-04 16:12:16 +01:00
dd98c7471d Manager: don't log event payload in event logging
Don't log event payload in MQTT/SocketIO debug logs. It's getting too
noisy.
2024-02-04 16:11:58 +01:00
740ede80fa Manager: log eventbus events with 'eventbus' prefix instead of 'socketio'
These messages are now no longer SocketIO-specific, so should use the
'eventbus' prefix.
2024-02-04 16:08:45 +01:00
b375acb1a1 Cleanup: add SPDX license identifiers 2024-02-03 23:42:51 +01:00
4fe8605744 Manager: Add MQTT client for sending events
Add an MQTT client to send events from the event bus to an MQTT broker.
2024-02-03 23:20:15 +01:00
2af9a3e98e Webapp: update documentation URL to the SocketIO client docs
No functional changes.
2024-02-03 22:55:27 +01:00
76a24243f0 Manager: Introduce event bus system
Introduce an "event bus"-like system. It's more like a fan-out
broadcaster for certain events. Instead of directly sending events to
SocketIO, they are now sent to the broker, which in turn sends it to any
registered "forwarder". Currently there is ony one forwarder, for
SocketIO.

This opens the door for a proper MQTT client that sends the same events
to an MQTT server.
2024-02-03 22:55:23 +01:00
4f8d39f74a Fix MSYS2 breaking the base URL for webapp
Add `MSYS2_ARG_CONV_EXCL="*"` to avoid MSYS2 changing the yarn build
`--base=/app/` argument. That's a URL path, not a filesystem path, and it
should be used as-is on every platform.
2024-02-02 22:37:28 +01:00
f464aea137 Manager & website: provide more helpful info when Worker auth fails
Provide more useful info when a Worker tries to communicate but fails
the authentication check. The message about this is now more friendly
and links to a new FAQ entry at
https://flamenco.blender.org/faq/#what-does-unknown-worker-is-trying-to-communicate-mean
2024-01-25 14:19:24 +01:00
26c14bf095 Website: better styling for FAQ page
More vertical space between answers in the FAQ.
2024-01-25 13:04:45 +01:00
9afd79d8c0 Manager: prevent logging an error when fetching unknown worker
Prevent logging an error in the persistence layer when an unknown worker
is requested.

This reduces the noise & confusion when the web interface is showing the
details of a worker, but the worker gets removed by someone else. Or when
the Manager doesn't know about a Worker and it's trying to connect.

See #104282.
2024-01-25 12:38:13 +01:00
70faa4e225 Move URLs to the Flamenco website to constants in a dedicated package
Create a dedicated package `.../pkg/website` to contain constants for the
URLs of documentation, bug reporting, etc. That way it's easier to see
which parts of the website are being referred to from the Flamenco
binaries, and updates can happen in a central spot.

No functional changes.
2024-01-25 12:25:06 +01:00
13a793743f Website: add documentation for worker tags and sleep schedule
The worker tags and sleep schedule features are now actually documented.
2024-01-25 12:15:29 +01:00
c3a306a9c5 Website: slight layout tweaks
A few smaller tweaks for the navigation menu (on the left, not the top):

- Smaller font. The upgrade to the latest Geekdocs made this bigger, but I
  like it if it's a bit smaller than the main text.
- More visible indicator line for the active element. This was a dashed
  underline of just the text. It is now a dashed border-bottom that extends
  the entire width of the element. This visibly connects the main body of
  text to the active menu element.

And for the main text:

- Less padding for `h3` elements, as the whitespace became a bit too much.
2024-01-25 12:14:27 +01:00
3233d40b4c Website: upgrade Hugo to 0.121.2
Upgrade Hugo from 0.101.0 to 0.121.2. This seems to not introduce any
changes for us.
2024-01-25 12:11:04 +01:00
781aaa8282 Website: upgrade geekdocs to 0.44.1
Upgrade the Geekdocs theme from 0.32.4 to 0.44.1. This changes the layout
a little bit; most notably the 'documentation' menu is in a larger font.

I tried the upgrade to solve an issue of images not appearing (while
writing not-yet-committed changes). That wasn't solved by the upgrade, but
in the spirit of keeping up to date I'd thought I'd commit this upgrade
anyway.
2024-01-25 11:29:22 +01:00
fd29f58c2e Website: move info about cloud storage into the main documentation
Move the info about using cloud storage from the FAQ to the Shared
Storage chapter of the documentation. The FAQ entry of the topic is now
reduced to a short answer + a link to the moved documentation.
2024-01-23 10:27:20 +01:00
27eb7be547 Website: reorganise FAQ
Reorganise the FAQ, grouping the questions in "Features" and
"Troubleshooting". Also I removed the explanation of the difference
between Flamenco v2 and v3, as that's quite obsolete now.
2024-01-17 13:22:57 +01:00
aa2ad35155 Bumped version to 3.5-alpha0 2024-01-17 13:17:35 +01:00
19d4019142 Website: add FAQ entries on GPU use of Blender
This comes up a lot.
2024-01-17 13:16:31 +01:00
f9520ce147 Website: remove FAQ about a BAT packing error
This error hasn't been reported in 9 months, so I'll assume it's fixed.
2024-01-17 13:06:00 +01:00
b16b44b4d6 Run go mod tidy 2024-01-13 13:08:29 +01:00
8b9a2a15cf CHANGELOG: marked 3.4 as released today 2024-01-12 11:15:55 +01:00
e1306010d7 Bumped version to 3.4 2024-01-12 11:14:50 +01:00
b39f116b0e Manager: after deleting a job, perform a database consistency check
Deleting jobs from the database can still sometimes cause consistency
errors, as if foreign key constraints aren't enabled. This check is there
to try and get a grip on things.
2024-01-11 20:03:53 +01:00
7c08ec8654 Upgrade dependencies
Go dependency upgrades, most importantly:

- github.com/glebarez/go-sqlite v1.21.1 -> v1.22.0
- github.com/glebarez/sqlite v1.8.0 -> v1.10.0
- gorm.io/gorm v1.25.2 -> v1.25.5
- modernc.org/sqlite v1.26.0 -> v1.28.0
2024-01-11 19:53:07 +01:00
c80f898095 Makefile: Run make vet as part of the release-package rule 2024-01-11 19:06:49 +01:00