greptilian logo

IRC log for #sourcefu, 2018-05-09

http://sourcefu.com

| Channels | #sourcefu index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
00:19 prologic bear: so wheb a masters expires the server publishes a different kind of event for consumers if interested?
00:19 prologic For what purpose ?
00:36 prologic so one thing to consider as well is that queueus really shouldn't have a TTL
00:36 prologic in that mixing time and memory or limits is kind of weird/bad
00:36 prologic a colleage of mine has argued that its better to have an upper bound on the size of the queues
00:36 prologic rather than a time based limit on how long each messave can live in the queue before being GCd
00:37 prologic this way what you do is enfoce an upper bound onf the size of the queue and start GC at the back of the queue (oldest items) to make room for new ones
00:42 prologic One thing I also want is metrics published for the amount of time messages are in queues
00:43 prologic meaning the t1 (time published) - t2 (time either explicitly fetched via GET or deleted via DELETE)
02:52 bear upper bound on size presumes that you have a known message rate
02:53 bear ttl allows you to enforce some semblance of order on the consumer dieing
02:53 bear the purpose I want for the "item has timed out event" is to allow a queue to survive a partition event without having to have a true bi-directional protocal implemented via queue
02:54 bear it's a pattern I saw implemented in zeromq that I liked
03:07 prologic Gmmm
03:08 prologic Isn’t a full Q easier to reason about
03:08 prologic Isn’t it easier to reason about memory limits versus time
03:09 prologic Ie: max queue size / max payload size
04:10 bear it can be - I live in a world where devs love to pass huge json blobs as message payloads
04:10 bear so we can go from 1000 msgs/sec using a gig of ram to using 10 gig
04:10 bear why? because they are passing a 150 mb json blob around  :(
04:38 prologic fuck me
04:38 prologic that's not what queues are meant for
04:44 bear :nods:
04:44 bear so yea, take my thoughts with a grain of salt as I have been painfully biased :)
15:51 prologic https://github.com/prologic/msgbus/pull/6
20:06 bear https://www.bleepingcomputer.com/news/security/backdoored-python-library-caught-stealing-ssh-credentials/
20:09 bear tl;dr is: if you use a module named ssh-decorate your credentials have been stolen

| Channels | #sourcefu index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

http://sourcefu.com