Hi,
Yes it is possible to create a RSS Feed with all existing Alerts (as well as you can specify a filter to show specific alerts ).
You have to create a dashboard with Alert List widget, where you can see list of all existing Alerts (or filter to see specific Alerts), then you can press RSS Feed button on the widget and it will create a RSS Feed.