We have recently added a keyboard shortcut to easily drop items from the inventory or delete them from the locker.
To drop an item from your inventory, hover over it and press Ctrl + D.
To delete an item from your locker, hover over it and press the Delete key.
Both keybinds are rebindable in the Controls setting.