[Core] General API/VFS and base Applications

[andersevenrud]

Before hitting an eventual beta, OS.js needs to nail down API and VFS "backend" methods and client integration.

Recently I've gotten some really good feeback that has finally initiated this process.

Core

• Add composition to handler to avoid duplicate code
• User Management for Handlers (Users management #383)
• Look into making an Express supported middleware layer (No npm package #470)

Packages

• Add support for less compile via metadata
• Add support for before/after hooks via metadata

Applications

• Implement search in FileManager ([Core] Search Engine #385)

API

• New descriptive URIs [Server] Improvements to API calls #302
• Refactor node server HTTP handling for "descriptive URIs"
• Refactor php server HTTP handling for "descriptive URIs"
• Group permission for apps ([API] Privileges via Groups #105)
• Blacklisting of apps per-user
• "Countable" locales ([General] "Countable" translation #291)
• Add checkVFSPrivilege() (VFS per-user permissions hook)
• Add checkPackagePrivilege() (Package per-user permissions hook)
• server-php does not support package permissions right now
• Copy/Paste files via keyboard
• Add Application::_api() with the default pattern and deprecate Application::_call() (over the next releases)
• Improve Search APIs ([Core] Search Engine #385)

VFS

• Check if mount is readonly before trying something (Should be implemented. No error in filemanger) ?
• New namespace for "transports"
• Better Handler integration [Server] Improvements to API calls #302
• Better dataSource handling on server
• Add support for mounting/unmounting client supported modules
• Add support for HTTP proxy file getting (including config/setting)
• Abstraction for VFS Modules in client
• Improve application error handling (in some cases like FileManager it will "hang")
• "Spring cleanup"
• Progress dialogs (realtime) on all VFS modules
• Read last modified timestamp on save functions
• WebDAV support ([VFS] WebDAV & OwnCloud #297)
• OwnCloud support ([VFS] WebDAV & OwnCloud #297)
• Extended DAV support ([VFS] WebDAV & OwnCloud #297)
• DAV Auth Header doc
• Send multiple operations over VFS methods
• Indexed file trees for quicker searches
• Disabling of default mounts (like osjs/apps) via src/conf

Misc

• Update homepage docs
• Ensure NW still works fine in nightly
• Ensure this transitions into Arduino branch/codebase
• Add docs/examples on how to do permissions

[andersevenrud]

@RickGlimmer This issue now superseeds #302 and #303.

[andersevenrud]

FYI: I am merging this into master as we speak :)

[andersevenrud]

@RickGlimmer Thoughts on the changes ? :)

[RickGlimmer]

I am testing them right now. :) It is a lot easier to work with that is for sure! 👍

[RickGlimmer]

The write could be a bit easier. :)
It is now:
{ data: "data:image/png;base64,iVBOR...."
path: "home:////New file.png" }

If you can split the data it would be great. Maybe like this:
{ path: "home:///New files.png", mime: "image/png", encoding: "base64", data: "iVBOR....."

[andersevenrud]

The "problem" is that the data is made with the browser APIs and comes with full data uri. Relevant: https://developer.mozilla.org/en-US/docs/Web/HTTP/data_URIs

I don't want to perform any string-type operations on this in the client (effectively doubles the needed ram usage).

The server assumes that write comes with base64 unless the raw options flag is set (binary).

[andersevenrud]

@RickGlimmer This problem can somewhat be "solved" another way. Instead of relying on write function on the server, it is possible to simply use the browser upload functinality. That way the transport is always arraybuffer.

It's something I'm considering.

But as you said, this made it a bit easier to work with, and avoid confusions with nested JSON to the APIs. Also debugging is a bit better in the browser now since it makes a distinct entry in the network monitor (no more "API" only. It actually shows the method used)

[junland]

+1 for group permissions :)

Also HTTPS with Let's Encrypt support?

[khoaakt]

Ahem, long time do not feedback for osjs 😄
I will talk about the desktop. Now, it's just support 'Shortcut' and can't copy or create file or folder on it. So, turn desktop into a folder like other operating systems!

[andersevenrud]

@khoaakt I'll look into that, but the current desktop icon view was designed to work as shortcuts.

I can maybe provide both solutions and have it in Settings

[andersevenrud]

Closing this issue. The remaining stuff will get its own issues when I get started