itcmcgrath

โœจย All opinions expressed or implied are mine and not the opinions of my employer.

I do database stuff. Cloud@Neo4j. Ex-Google databases (Datastore, Firestore, Bigtable, App Engine Search)

https://twitter.com/daniswrong https://stackoverflow.com/users/153407/dan-mcgrath

๐Ÿ“… Joined in 2010

๐Ÿ”ผ 1,102 Karma

โœ๏ธ 283 posts

๐ŸŒ€
15 latest posts

Load

(Replying to PARENT post)

German goes into some of the details here: https://neo4j.com/blog/graph-database/property-sharding-infi...
๐Ÿ‘คitcmcgrath๐Ÿ•‘1mo๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

* >20 when this was published in 2016.
๐Ÿ‘คitcmcgrath๐Ÿ•‘3y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

The most important part is at the end:

According to Agnieszka Grabska-Barwinska, a member of the team, the graph neural network learned to encode a pattern that physicists call correlation length. That is, as DeepMindโ€™s graph neural network restructured itself to reflect the training data, it came to exhibit the following tendency: When predicting propensities at higher temperatures (where molecular movement looks more liquid-like than solid), for each nodeโ€™s prediction the network depended on information from neighboring nodes two or three connections away in the graph. But at lower temperatures closer to the glass transition, that number โ€” the correlation length โ€” increased to five.

โ€œWe see that the network extracts, as we lower the temperature, information from larger and larger neighborhoodsโ€ of particles, said Thomas Keck, a physicist on the DeepMind team. โ€œAt these different temperatures, the glass looks, to the naked eye, just identical. But the network sees something different as we go down.โ€

Increased correlation length is a hallmark of phase transitions, in which particles transition from a disordered to an ordered arrangement or vice versa. It happens, for instance, when atoms in a block of iron collectively align so that the block becomes magnetized. As the block approaches this transition, each atom influences atoms farther and farther away in the block.

๐Ÿ‘คitcmcgrath๐Ÿ•‘5y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

๐Ÿ‘คitcmcgrath๐Ÿ•‘5y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

It was 2015 when I first encountered this while working with Andrew and James. I couldn't find any online info on the origin, and the few Firebasers I asked couldn't tell me. I feel like I have closure now that it really wasn't a thing. Or, I guess it was and it really is now.

It's funny how little things can snowball.

๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

Only 89 (it wasn't KFC). But yes; common pattern.
๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

I've been around a company that was 180+ years old (so rebranding was non-trivial ;)). They switched to an acronym based on the original name, so there was was 1) a direct link between old and new, 2) old branded tgat was mussed wasnt a big deal for bew customers, and 3) everyone called it by the acronym going forward.

A similar approach might work for you and allow an incremential phase out of the old brand over time. Instead of HxHxHx, it's now HITD (HxHxHx IT Desktop)

๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

One example would be where you have conditional logic that requires a database call. Without workers, everything would go back to the backend system, perhaps across the ocean. With workers in front you could shortcircuit that for all calls that don't require the DB call. You could also handle routing logic at that layer, allowing it to pick closer DB instances, etc.

[Disclaimer: Product Manager on Cloud Firestore who thought this was an interesting use-case]

๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ0๐Ÿ—จ๏ธ0
๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ34๐Ÿ—จ๏ธ9

(Replying to PARENT post)

Status board is green: https://status.salesforce.com/ But reports of log-in issues are slightly up: https://downdetector.com/status/salesforcecom
๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

We listed a sample in the blog post, including The Telegraph, The New York Times, Skip Scooters, Now IMS, and Hawkin Dynamics
๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

Thank you for being a paying user.

1. Mainly because it's both a different search problem (general DB vs specific to web search) and hard engineering wise given our model; we implement not only the cloud database, but embedded versions for iOS, Android, and Web - not to mention real-time functionality and tailoring it to how our index engine works, etc. While we have a lot of customers and use-cases that don't need Fulltext Search, we totally agree it's important and have done explorations on how we'd deliver something along these lines.

2. Agreed. During the beta program we've delivered the managed export and import service for backups, adding array contains capabilities to queries and have got close enough to delivering Collection Group queries to mention them as part of GA. For documentation our tech writing team as done a lot of updates, new pages, and fixes - we know there is always more to do. Cloud Firestore is definitely used in production and at scale by our customers, and with nearly 1 million databases being created the range of use cases and traffic/load patterns has been vast. Our beta program involved working with a lot of them to improve things like hardening and scalability to ensure we can meet our 5 nines of availability SLA.

"Isn't half a solution better than no solution?" -> In a lot of cases, absolutely not. A half solution that falls over when you tip a certain point of scale can result in extended downtimes, since the solution often ends up being "we need to completely rearchitect this", which isn't easy or quick when your business is out of commission.

"from the perspective of a customer and outside observer, a number of things smell quite off." -> Sorry to hear this, I can only hope the continued hard work from the team will turn you around.

๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

If Cloud Spanner is too big, then you'll almost certainly be well served by Cloud SQL (fully managed MySQL and PostgreSQL): http://cloud.google.com/sql/
๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ0๐Ÿ—จ๏ธ0

(Replying to PARENT post)

We built it specifically for Cloud Firestore and as an integral part of the system from the beginning. We always like to hear where we can do better to help prioritize the next set of improvements, and would love to know what gives you the impression of being bolted on.
๐Ÿ‘คitcmcgrath๐Ÿ•‘6y๐Ÿ”ผ0๐Ÿ—จ๏ธ0