Predicting positive and negative links in online social networks
Jure LeskovecDaniel HuttenlocherJon Kleinberg
Demonstrates how machine learning models can accurately predict friendly and antagonistic relationships across diverse online networks by leveraging classical social psychology theories of balance and status.
Online social platforms depend heavily on recommendation algorithms to suggest new connections, manage trust, and curate content. Most social network analyses exclusively study positive relationships, such as friendships or follows, ignoring negative attitudes like distrust, disapproval, or antagonism. Failing to account for negative ties introduces significant risks of recommending unwanted or adversarial connections to users, undermining user experience and trust. To resolve this, the article investigates how negative relationships interact with positive ties and evaluates whether the sentiment of a hidden link can be accurately inferred from the surrounding social network structure.
The article demonstrates a supervised machine-learning framework using logistic regression to predict whether a given relationship is positive or negative, while simultaneously testing fundamental social-psychology theories of structural balance and status. The researchers evaluated their approach across three diverse, large-scale online communities where users explicitly record positive and negative ties: Epinions (distrust and trust ratings), Slashdot (foe and friend tags), and Wikipedia (negative and positive promotion votes for administrator roles), spanning networks ranging from over 7,000 to nearly 120,000 nodes where positive links comprise roughly 77% to 85% of all connections.
The analysis yielded several critical findings. First, local structural features—specifically the user's incoming and outgoing link counts and the configuration of shared three-node triads—predict edge signs with high accuracy, achieving 90% to 95% accuracy on full datasets and error rates as low as roughly 6.6% on balanced benchmarks, significantly outperforming prior propagation methods. Second, the predictive models generalize remarkably well across platforms; models trained on Wikipedia, for example, accurately predict link sentiments on Slashdot and Epinions with almost no performance loss. Third, negative ties provide critical context for standard network tasks: incorporating negative link data boosted the accuracy of predicting latent positive relationships by up to a factor of 1.5 over random baseline guessing compared to using positive links alone. Finally, while local relationships reflect a mix of structural balance (such as shared allies) and status hierarchies, global network analysis reveals an approximate overarching status hierarchy (satisfying 80% to 85% of edges) but finds virtually no evidence of global division into two polarized factions.
These findings prove that positive and negative interactions are deeply intertwined and must be modeled together rather than treated as independent features. In practical social computing applications, organizations can leverage local network topology to reliably estimate user sentiment and filter out hostile recommendations without needing complex global analyses. However, decision-makers should note that prediction performance is lower on Wikipedia (around 80% accuracy) than on Epinions or Slashdot (over 92%), showing that public, high-stakes decisions depend more heavily on external qualitative information than casual social interactions do.
Stakeholders and platform designers should integrate negative edge data into recommender systems and community moderation tools to improve recommendation quality and avoid recommending antagonistic interactions. Teams seeking immediate baseline improvements can leverage simple heuristic rules based on out-degree or status differentials, though full triad-based models deliver superior precision. For future initiatives, organizations should invest in pilot programs to test sentiment-prediction algorithms on implicit sentiment data (such as textual interactions or unlabeled web links) and further investigate the theoretical bridge between local social dynamics and macroscopic network behavior.
- Paper: The link prediction problem for social networks, David Liben-Nowell et al. (2003). This paper establishes the foundational topological proximity measures and evaluation framework for link prediction in social networks that the source builds upon for signed graphs.
- Paper: Hierarchical structure and the prediction of missing links in networks, Aaron Clauset et al. (2008). This work introduces techniques for predicting missing links using hierarchical and structural network patterns, providing key conceptual foundations for network link estimation.
- Paper: SimRank: a measure of structural-context similarity, Glen Jeh et al. (2002). This paper introduces structural-context similarity over graph topologies, which underpins the node-relation scoring mechanisms adapted in social network prediction.
- Paper: Group formation in large social networks: membership, growth, and evolution, Lars Backstrom et al. (2006). This study analyzes how local triad structures and social neighbor connectivity drive tie formation, directly informing the structural balance and triad features used in the source paper.
- Paper: Mining knowledge-sharing sites for viral marketing, Matthew Richardson et al. (2002). This research provides empirical grounding in online trust network datasets like Epinions that are subsequently leveraged to study signed positive and negative ties.
- Paper: Link Prediction in Complex Networks: A Survey, Linyuan Lu et al. (2010). This comprehensive survey categorizes and contextualizes link prediction algorithms across complex networks, extending the specific findings of signed link classification into broader network theory.
- Paper: Recommender systems with social regularization, Hao Ma et al. (2011). This paper applies signed and trust network relationships to regularize matrix factorization models for recommender systems.
- Paper: A Three-Way Model for Collective Learning on Multi-Relational Data, Maximilian Nickel et al. (2011). This work generalizes the prediction of multiple relational edge types and link signs through collective tensor factorization.
- Paper: Link Prediction Based on Graph Neural Networks, Muhan Zhang et al. (2018). This study advances link prediction beyond handcrafted heuristic and balance features by using graph neural networks to learn predictive patterns directly from enclosing subgraphs.
- Paper: node2vec: Scalable Feature Learning for Networks, Aditya Grover et al. (2016). This work develops scalable representation learning methods that automatically learn low-dimensional feature vectors to predict edges and relationship properties in complex networks.
- Paper: Graph Neural Networks for Social Recommendation, Wenqi Fan et al. (2019). This paper uses graph neural networks to integrate user opinion polarities and social network links to improve consumer rating predictions on datasets like Epinions.
- Paper: KONECT: the Koblenz network collection, Jérôme Kunegis (2013). This paper establishes a large-scale repository and algebraic analysis suite for network graphs, formalizing signed and directed relationships across benchmark datasets.
