title: Simulating Spin-Orbit Coupling With Quasidegenerate N-Electron Valence Perturbation Theory

abstract: We present the first implementation of spin-orbit coupling effects in fully internally contracted second-order quasidegenerate N-electron valence perturbation theory (SO-QDNEVPT2). The SO-QDNEVPT2 approach enables the computations of ground- and excited-state energies and oscillator strengths combining the description of static electron correlation with an efficient treatment of dynamic correlation and spin-orbit coupling. In addition to SO-QDNEVPT2 with the full description of one- and two-body spin-orbit interactions at the level of two-component Breit-Pauli Hamiltonian, our implementation also features a simplified approach that takes advantage of spin-orbit mean-field approximation (SOMF-QDNEVPT2). The accuracy of these methods is tested for the group 14 and 16 hydrides, 3d and 4d transition metal ions, and two actinide dioxides (neptunyl and plutonyl dications). The zero-field splittings of group 14 and 16 molecules computed using SO-QDNEVPT2 and SOMF-QDNEVPT2 are in a good agreement with the available experimental data. For the 3d transition metal ions, the SO-QDNEVPT2 method is significantly more accurate than SOMF-QDNEVPT2, while no substantial difference in the performance of two methods is observed for the 4d ions. Finally, we demonstrate that for the actinide dioxides the results of SO-QDNEVPT2 and SOMF-QDNEVPT2 are in a good agreement with the data from previous theoretical studies of these systems. Overall, our results demonstrate that SO-QDNEVPT2 and SOMF-QDNEVPT2 are promising multireference methods for treating spin-orbit coupling with a relatively low computational cost.


title: Anomalies and the Green-Schwarz Mechanism

abstract: Anomalies are a very powerful tool in constraining theories beyond the standard model. We give a pedagogical overview of some topics illustrating the important role played by spacetime anomalies in string theory. After discussing the general problem of anomaly cancellation in quantum field theory, the focus is set on the cancellation of anomalies in type-I string theory through the Green-Schwarz mechanism. The notion of anomaly inflow is also reviewed, as well as its application to the evaluation of D-brane anomalous couplings. Finally, we briefly comment on recent developments concerning the reformulation of anomalies in the language of category theory.


title: Quantum correlations in the frustrated XY model on the honeycomb lattice

abstract: We consider the spin-$1/2$ XY frustrated antiferromagnetic Heisenberg honeycomb model. There is an unclear intermediate region in the ground state phase diagram of the model. The most recognized phases are the quantum spin-liquid (QSL) and the antiferromagnetic Ising ordering. From the viewpoint of the quantum correlations, the QSL phase is expected to be entangled. Motivated by this fact, we have calculated the concurrence, the quantum discord (QD), and the entanglement entropy, by using numerical Lanczos and density matrix renormalization group (DMRG) methods. Our results explicitly show that the intermediate region should be entangled supporting the QSL phase.


title: Effective exponential bounds on the prime gaps

abstract: Over the last 50 years a large number of effective exponential bounds on the first Chebyshev function $\vartheta(x)$ have been obtained. Specifically we shall be interested in effective exponential bounds of the form \[ |\vartheta(x)-x| < a \;x \;(\ln x)^b \; \exp\left(-c\; \sqrt{\ln x}\right); \qquad (x \geq x_0). \] Herein we shall convert these effective bounds on $\vartheta(x)$ into effective exponential bounds on the prime gaps $g_n = p_{n+1}-p_n$. Specifically we shall establish a number of effective exponential bounds of the form \[ {g_n\over p_n} < { 2a \;(\ln p_n)^b \; \exp\left(-c\; \sqrt{\ln p_n}\right) \over 1- a \;(\ln p_n)^b \; \exp\left(-c\; \sqrt{\ln p_n}\right)}; \qquad (x \geq x_*); \] and \[ {g_n\over p_n} < 3a \;(\ln p_n)^b \; \exp\left(-c\; \sqrt{\ln p_n}\right); \qquad (x \geq x_*); \] for some effective computable $x_*$. It is the explicit presence of the exponential factor, with known coefficients and known range of validity for the bound, that makes these bounds particularly interesting.


title: More Generalized and Personalized Unsupervised Representation Learning In A Distributed System

abstract: Discriminative unsupervised learning methods such as contrastive learning have demonstrated the ability to learn generalized visual representations on centralized data. It is nonetheless challenging to adapt such methods to a distributed system with unlabeled, private, and heterogeneous client data due to user styles and preferences. Federated learning enables multiple clients to collectively learn a global model without provoking any privacy breach between local clients. On the other hand, another direction of federated learning studies personalized methods to address the local heterogeneity. However, work on solving both generalization and personalization without labels in a decentralized setting remains unfamiliar. In this work, we propose a novel method, FedStyle, to learn a more generalized global model by infusing local style information with local content information for contrastive learning, and to learn more personalized local models by inducing local style information for downstream tasks. The style information is extracted by contrasting original local data with strongly augmented local data (Sobel filtered images). Through extensive experiments with linear evaluations in both IID and non-IID settings, we demonstrate that FedStyle outperforms both the generalization baseline methods and personalization baseline methods in a stylized decentralized setting. Through comprehensive ablations, we demonstrate our design of style infusion and stylized personalization improve performance significantly.


title: Adaptive Basis Sets for Practical Quantum Computing

abstract: Electronic structure calculations on small systems such as H$_2$, H$_2$O, LiH, and BeH$_2$ with chemical accuracy are still a challenge for the current generation of the noisy intermediate-scale quantum (NISQ) devices. One of the reasons is that due to the device limitations, only minimal basis sets are commonly applied in quantum chemical calculations, which allow one to keep the number of qubits employed in the calculations at minimum. However, the use of minimal basis sets leads to very large errors in the computed molecular energies as well as potential energy surface shapes. One way to increase the accuracy of electronic structure calculations is through the development of small basis sets better suited for quantum computing. In this work, we show that the use of adaptive basis sets, in which exponents and contraction coefficients depend on molecular structure, provide an easy way to dramatically improve the accuracy of quantum chemical calculations without the need to increase the basis set size and thus the number of qubits utilized in quantum circuits. As a proof of principle, we optimize an adaptive minimal basis set for quantum computing calculations on an H$_2$ molecule, in which exponents and contraction coefficients depend on the H-H distance, and apply it to the generation of H$_2$ potential energy surface on IBM-Q quantum devices. The adaptive minimal basis set reaches the accuracy of the double-zeta basis sets, thus allowing one to perform double-zeta quality calculations on quantum devices without the need to utilize twice as many qubits in simulations. This approach can be extended to other molecular systems and larger basis sets in a straightforward manner.


title: The Stackelberg Game: responses to regular strategies

abstract: Following the solution to the One-Round Voronoi Game in arXiv:2011.13275, we naturally may want to consider similar games based upon the competitive locating of points and subsequent dividing of territories. In order to appease the tears of White (the first player) after they have potentially been tricked into going first in a game of point-placement, an alternative game (or rather, an extension of the Voronoi game) is the Stackelberg game where all is not lost if Black (the second player) gains over half of the contested area. It turns out that plenty of results can be transferred from One-Round Voronoi Game and what remains to be explored for the Stackelberg game is how best White can mitigate the damage of Black's placements. Since significant weaknesses in certain arrangements were outlined in arXiv:2011.13275, we shall first consider arrangements that still satisfy these results (namely, White plays a certain grid arrangement) and then explore how Black can best exploit these positions.


title: The Igusa-Todorov $\phi$-dimension on Morita context algebras

abstract: In this article we prove that, under certain hypotheses, Morita context algebras that have zero bimodule morphisms have finite $\phi$-dimension. We also study the behaviour of the $\phi$-dimension for an algebra and its opposite. In particular we show that the $\phi$-dimension of an Artin algebra is not symmetric, i.e. there exists a finite dimensional algebra $A$ such that $\phi\dim (A) \not = \phi\dim (A^{op})$.


title: Speech-to-Speech Translation For A Real-world Unwritten Language

abstract: We study speech-to-speech translation (S2ST) that translates speech from one language into another language and focuses on building systems to support languages without standard text writing systems. We use English-Taiwanese Hokkien as a case study, and present an end-to-end solution from training data collection, modeling choices to benchmark dataset release. First, we present efforts on creating human annotated data, automatically mining data from large unlabeled speech datasets, and adopting pseudo-labeling to produce weakly supervised data. On the modeling, we take advantage of recent advances in applying self-supervised discrete representations as target for prediction in S2ST and show the effectiveness of leveraging additional text supervision from Mandarin, a language similar to Hokkien, in model training. Finally, we release an S2ST benchmark set to facilitate future research in this field. The demo can be found at https://huggingface.co/spaces/facebook/Hokkien_Translation .


title: High-Level Synthesis for Packet-Processing Pipelines

abstract: Compiling high-level programs to target high-speed packet-processing pipelines is a challenging combinatorial optimization problem. The compiler must configure the pipeline's resources to match the high-level semantics of the program, while packing all of the program's computation into the pipeline's limited resources. State of the art approaches tackle individual aspects of this problem. Yet, they miss opportunities to efficiently produce globally high-quality outcomes. We argue that High-Level Synthesis (HLS), previously applied to ASIC/FPGA design, is the right framework to decompose the compilation problem for pipelines into smaller pieces with modular solutions. We design an HLS-based compiler that works in three phases. Transformation rewrites programs to use more abundant pipeline resources, avoiding scarce ones. Synthesis breaks complex transactional code into configurations of pipelined compute units. Allocation maps the program's compute and memory to the hardware resources. We prototype these ideas in a compiler, CaT, which targets the Tofino pipeline and a cycle-accurate simulator of a Verilog hardware model of an RMT pipeline. CaT can handle programs that existing compilers cannot currently run on pipelines, generating code faster than existing compilers, while using fewer pipeline resources.


title: Quantum nonlocality: How does nature do it?

abstract: In a recent note, Hance and Hossenfelder (arXiv:2211.01331) recall that "locally causal completions of quantum mechanics are possible, if they violate the assumption [called statistical independence or measurement independence] that the hidden variables do not in any way depend on measurement settings" and that, consequently, the experimental violations of Bell inequalities "show that maintaining local causality requires violating statistical independence". However, Hance and Hossenfelder also argue that "we should (...) look for independent experimental evidence that can distinguish the two different options: non-locality and statistical independence, or locality and violations of statistical independence" and that "the unwillingness to consider theories without statistical independence may be the reason we do not yet have a locally causal theory for the foundations of physics that is consistent with general relativity". Here, we recall that there is a third option, namely, rejecting that measurement outcomes are governed in any way by hidden variables. Moreover, we argue that some recent results in the search for principles singling out the sets of quantum correlations for Bell and Kochen-Specker contextuality scenarios point out that this third option is scientifically more plausible and answers the question of why and how nature produces quantum nonlocality.


title: On Measuring Cognition and Cognitive Augmentation

abstract: We are at the beginning of a new age in which artificial entities will perform significant amounts of high-level cognitive processing rivaling and even surpassing human thinking. The future belongs to those who can best collaborate with artificial cognitive entities achieving a high degree of cognitive augmenta-tion. However, we currently lack theoretically grounded fundamental metrics able to describe human or artificial cognition much less augmented and combined cognition. How do we measure thinking, cognition, information, and knowledge in an implementation-independent way? How can we tell how much thinking an artificial entity does and how much is done by a human? How can we measure the combined and possible even emergent effect of humans working together with intelligent artificial entities? These are some of the challenges for research-ers in this field. We first define a cognitive process as the transformation of data, information, knowledge, and wisdom. We then review several existing and emerging information metrics based on entropy, processing effort, quantum physics, emergent capacity, and human concept learning. We then discuss how these fail to answer the above questions and provide guidelines for future re-search.


title: Exploring Sequence-to-Sequence Transformer-Transducer Models for Keyword Spotting

abstract: In this paper, we present a novel approach to adapt a sequence-to-sequence Transformer-Transducer ASR system to the keyword spotting (KWS) task. We achieve this by replacing the keyword in the text transcription with a special token <kw> and training the system to detect the <kw> token in an audio stream. At inference time, we create a decision function inspired by conventional KWS approaches, to make our approach more suitable for the KWS task. Furthermore, we introduce a specific keyword spotting loss by adapting the sequence-discriminative Minimum Bayes-Risk training technique. We find that our approach significantly outperforms ASR based KWS systems. When compared with a conventional keyword spotting system, our proposal has similar performance while bringing the advantages and flexibility of sequence-to-sequence training. Additionally, when combined with the conventional KWS system, our approach can improve the performance at any operation point.


title: Calculating Cognitive Augmentation, A Case Study

abstract: We are entering an era in which humans will increasingly work in partnership and collaboration with artificially intelligent entities. For millennia, tools have augmented human physical and mental performance but in the coming era of cognitive systems, human cognitive performance will be augmented. We are only just now beginning to define the fundamental concepts and metrics to describe, characterize, and measure augmented and collaborative cognition. In this paper, the results of a cognitive augmentation experiment are discussed and we calculate the increase in cognitive accuracy and cognitive precision. In the case study, cognitively augmented problem solvers show an increase of 74% in cognitive accuracy (the ability to synthesize desired answers) and a 27% increase in cognitive precision (the ability to synthesize only desired answers). We offer a formal treatment of the case study results and propose cognitive accuracy and cognitive precision as standard metrics to describe and measure human cognitive augmentation.


title: Tropical Extensions and Baker-Lorscheid Multiplicities for Idylls

abstract: In a recent paper, Matthew Baker and Oliver Lorscheid showed that Descartes's Rule of Signs and Newton's Polygon Rule can both be interpreted as multiplicities of polynomials over hyperfields. Hyperfields are a generalization of fields which encode things like the arithmetic of signs or of absolute values. By looking at multiplicities of polynomials over such algebras, Baker and Lorscheid showed that you can recover the rules of Descartes and Newton. In this paper, we define tropical extensions for idylls. Such extensions have appeared for semirings with negation symmetries in the work of Akian-Gaubert-Guterman and for hypergroups and hyperfields in the work of Bowler-Su. Examples of tropical extensions are extending the tropical hyperfield to higher ranks, or extending the hyperfield of signs to the tropical real hyperfield by including a valuation. The results of this paper concern the interaction of multiplicities and tropical extensions. First, there is a lifting theorem from initial forms to the entire polynomial from which we will show that multiplicities for a polynomial are equal to the corresponding multiplicity for some initial form. Second, we show that tropical extensions preserve the property that the sum of all multiplicities is bounded by the degree. Consequentially, we have this degree bound for every stringent hyperfield. This gives a partial answer to a question posed by Baker and Lorscheid about which hyperfields have this property.


title: Non-Local Gravity Wormholes

abstract: We consider Non-local Gravity in view to obtain stable and traversable wormhole solutions. In particular, the class of Non-local Integral Kernel Theories of Gravity, with the inverse d'Alembert operator in the gravitational action, is taken into account. We obtain constraints for the null energy condition and derive the field equations. Two special cases for the related Klein-Gordon equation are assumed: one where the function in the gravitational action has a linear form and another one with exponential form. In each case, we take into account two forms for scalar fields and derive the shape functions. Asymptotic flatness and flaring-out conditions are checked. Energy conditions and dynamics of the solutions are examined at the throat. The main result is that non-local gravity contributions allow stability and traversability of the wormhole without considering any exotic matter.


title: Augmenting Transformer-Transducer Based Speaker Change Detection With Token-Level Training Loss

abstract: In this work we propose a novel token-based training strategy that improves Transformer-Transducer (T-T) based speaker change detection (SCD) performance. The conventional T-T based SCD model loss optimizes all output tokens equally. Due to the sparsity of the speaker changes in the training data, the conventional T-T based SCD model loss leads to sub-optimal detection accuracy. To mitigate this issue, we use a customized edit-distance algorithm to estimate the token-level SCD false accept (FA) and false reject (FR) rates during training and optimize model parameters to minimize a weighted combination of the FA and FR, focusing the model on accurately predicting speaker changes. We also propose a set of evaluation metrics that align better with commercial use cases. Experiments on a group of challenging real-world datasets show that the proposed training method can significantly improve the overall performance of the SCD model with the same number of parameters.


title: Toward Models of Impact and Recovery of the US Western Grid from Earthquake Events

abstract: A Cascadia Subduction Zone (CSZ) earthquake will cause widespread damage to numerous lifelines and infrastructure along the northern US west coast. The goal of the presented research is to provide a bottom up estimate of the impact on and subsequent recovery of a Cascadia Subduction Zone earthquake on the US western grid to supplement and enhance the expert opinion estimates provided to date. The scope is limited to consideration of shaking damage to utility substation equipment components of a power system model. The analysis utilizes probabilistic models of damage and recovery for substation power system assets, along with graph techniques for modeling connectivity, and Monte Carlo quasi steady state power flow solutions. The results show that a conservative estimate of the initial damage and loss of load is approximately 4,000 MW, with a recovery estimate of 230 days.


title: A regular $n$-gon spiral

abstract: We construct a polygonal spiral by arranging a sequence of regular $n$-gons such that each $n$-gon shares a specified side and vertex with the $(n+1)$-gon in the construction. By offering flexibility for determining the size of each $n$-gon in the spiral, we show that a number of different analytical and asymptotic behaviors can be achieved.


title: On automorphism group of a possible short algorithm for multiplication of $3\times3$ matrices

abstract: Studying algorithms admitting nontrivial symmetries is a prospective way of constructing new short algorithms of matrix multiplication. The main result of the article is that if there exists an algorithm of multiplicative length $l\leq22$ for multuplication of $3\times3$ matrices then its automorphism group is isomorphic to a subgroup of $S_l\times S_3$.


title: Estimating the mass-to-distance ratio for a set of megamaser AGN black holes by employing a general relativistic method

abstract: Context. Motivated by the recent achievements of a full general relativistic method in determining black hole (BH) parameters, we continue to estimate the mass-to-distance ratio of the supermassive BHs hosted at the core of the active galactic nuclei (AGNs) of the megamaser galaxies NGC 1320, NGC 1194, NGC 5495, and Mrk 1029. Aims. Our aim is to study the properties of super massive BHs at the centers of the selected AGNs by using a full general relativistic method that allows us to address the potential detection of relativistic effects within such astrophysical systems. Methods. In order to perform statistical estimations with publicly available observational data, we used a general relativistic model that describes BH rotation curves and further employed a Bayesian fitting method. Results. We estimated the mass-to-distance ratio of the aforementioned BHs, their position and the recessional redshifts of the host galaxies produced by both peculiar motion and cosmological expansion of the Universe. Finally, we calculated the gravitational redshift of the closest maser to the BH for each AGN. This gravitational redshift is a general relativistic effect produced by the gravitational field of the BH properly included in the modelling.


title: On the partition function of the $Sp(2n)$ integrable vertex model

abstract: We study the partition function per site of the integrable $Sp(2n)$ vertex model on the square lattice. We establish a set of transfer matrix fusion relations for this model. The solution of these functional relations in the thermodynamic limit allows us to compute the partition function per site of the fundamental $Sp(2n)$ representation of the vertex model. In addition, we also obtain the partition function of vertex models mixing the fundamental with other representations.


title: Continuum kinetic investigation of the impact of bias potentials in the current saturation regime on sheath formation

abstract: In this work, we examine sheath formation in the presence of bias potentials in the current saturation regime for pulsed power fusion experiments. It is important to understand how the particle and heat fluxes at the wall may impact the wall material and affect electrode degradation. Simulations are performed using the 1X-1V Boltzmann-Poisson system for a proton-electron plasma in the presence of bias potentials ranging from 0 to 10 kV. The results indicate that the sheath near the high potential wall remains generally the same as that of a classical sheath without the presence of a bias potential. However, the sheath near the low potential wall becomes more prominent with a larger potential drop, a significant decrease of electron density, and larger sheath lengths. The spatially constant current density increases to a saturation value with increasing bias potential. The current is dominated by the ions at the low potential wall and by the electrons at the high potential wall. The heat flux increases to a saturation value at the high potential wall and tends to zero at the low potential wall with increasing bias potential. The results trend with theory with differences attributed to the simplified assumptions in the theory and the kinetic effects considered in the simulations. Due to the significant computational cost of a well resolved 1X-2V simulation, only one such simulation is performed for the 5 kV case showing higher current.


title: Equivariance with Learned Canonicalization Functions

abstract: Symmetry-based neural networks often constrain the architecture in order to achieve invariance or equivariance to a group of transformations. In this paper, we propose an alternative that avoids this architectural constraint by learning to produce canonical representations of the data. These canonicalization functions can readily be plugged into non-equivariant backbone architectures. We offer explicit ways to implement them for some groups of interest. We show that this approach enjoys universality while providing interpretable insights. Our main hypothesis, supported by our empirical results, is that learning a small neural network to perform canonicalization is better than using predefined heuristics. Our experiments show that learning the canonicalization function is competitive with existing techniques for learning equivariant functions across many tasks, including image classification, $N$-body dynamics prediction, point cloud classification and part segmentation, while being faster across the board.


title: A Non-Volatile All-Spin Non-Binary Matrix Multiplier: An Efficient Hardware Accelerator for Machine Learning

abstract: We propose and analyze a compact and non-volatile nanomagnetic (all-spin) non-binary matrix multiplier performing the multiply-and-accumulate (MAC) operation using two magnetic tunnel junctions - one activated by strain to act as the multiplier, and the other activated by spin-orbit torque pulses to act as a domain wall synapse that performs the operation of the accumulator. It has two advantages over the usual crossbar-based electronic non-binary matrix multiplier. First, while the crossbar architecture requires N3 devices to multiply two matrices, we require only 2N2 devices. Second, our matrix multiplier is non-volatile and retains the information about the product matrix after being powered off. Here, we present an example where each MAC operation can be performed in ~5 ns and the maximum energy dissipated per operation is ~60Nmax aJ, where Nmax is the largest matrix size. This provides a very useful hardware accelerator for machine learning and artificial intelligence tasks which involve the multiplication of large matrices. The non-volatility allows the matrix multiplier to be embedded in powerful non-von-Neumann architectures, including processor-in-memory. It also allows much of the computing to be done at the edge (of internet-of-things) while reducing the need to access the cloud, thereby making artificial intelligence more resilient against cyberattacks.

categories: cs.ET cond-mat.mes-hall cs.SY eess.SP eess.SY physics.app-ph


title: Integrating machine learning concepts into undergraduate classes

abstract: In this innovative practice work-in-progress paper, we compare two different methods to teach machine learning concepts to undergraduate students in Electrical Engineering. While machine learning is now being offered as a senior-level elective in several curricula, this does not mean all students are exposed to it. Exposure to the concepts and practical applications of machine learning will assist in the creation of a workforce ready to tackle problems related to machine learning, currently a hot topic in industry. Preliminary assessments indicate that this approach promotes student learning. While students prefer the proposed side-by-side teaching approach, numerical comparisons show that the workshop approach may be more effective for student learning, indicating that further work in this area is required.


title: Some aspects of noise in binary classification with quantum circuits

abstract: We formally study the effects of a restricted single-qubit noise model inspired by real quantum hardware, and corruption in quantum training data, on the performance of binary classification using quantum circuits. We find that, under the assumptions made in our noise model, that the measurement of a qubit is affected only by the noises on that qubit even in the presence of entanglement. Furthermore, when fitting a binary classifier using a quantum dataset for training, we show that noise in the data can work as a regularizer, implying potential benefits from the noise in certain cases for machine learning problems.


title: Handling Trade-Offs in Speech Separation with Sparsely-Gated Mixture of Experts

abstract: Employing a monaural speech separation (SS) model as a front-end for automatic speech recognition (ASR) involves balancing two kinds of trade-offs. First, while a larger model improves the SS performance, it also requires a higher computational cost. Second, an SS model that is more optimized for handling overlapped speech is likely to introduce more processing artifacts in non-overlapped-speech regions. In this paper, we address these trade-offs with a sparsely-gated mixture-of-experts (MoE) architecture. Comprehensive evaluation results obtained using both simulated and real meeting recordings show that our proposed sparsely-gated MoE SS model achieves superior separation capabilities with less speech distortion, while involving only a marginal run-time cost increase.


title: Rethinking Data-driven Networking with Foundation Models: Challenges and Opportunities

abstract: Foundational models have caused a paradigm shift in the way artificial intelligence (AI) systems are built. They have had a major impact in natural language processing (NLP), and several other domains, not only reducing the amount of required labeled data or even eliminating the need for it, but also significantly improving performance on a wide range of tasks. We argue foundation models can have a similar profound impact on network traffic analysis, and management. More specifically, we show that network data shares several of the properties that are behind the success of foundational models in linguistics. For example, network data contains rich semantic content, and several of the networking tasks (e.g., traffic classification, generation of protocol implementations from specification text, anomaly detection) can find similar counterparts in NLP (e.g., sentiment analysis, translation from natural language to code, out-of-distribution). However, network settings also present unique characteristics and challenges that must be overcome. Our contribution is in highlighting the opportunities and challenges at the intersection of foundation models and networking.


title: Investigating co-occurrences of MITRE ATT\&CK Techniques

abstract: Cyberattacks use adversarial techniques to bypass system defenses, persist, and eventually breach systems. The MITRE ATT\&CK framework catalogs a set of adversarial techniques and maps between adversaries and their used techniques and tactics. Understanding how adversaries deploy techniques in conjunction is pivotal for learning adversary behavior, hunting potential threats, and formulating a proactive defense. The goal of this research is to aid cybersecurity practitioners and researchers in choosing detection and mitigation strategies through co-occurrence analysis of adversarial techniques reported in MITRE ATT&CK. We collect the adversarial techniques of 115 cybercrime groups and 484 malware from the MITRE ATT\&CK. We apply association rule mining and network analysis to investigate how adversarial techniques co-occur. We identify that adversaries pair T1059: Command and scripting interface and T1105: Ingress tool transfer techniques with a relatively large number of ATT\&CK techniques. We also identify adversaries using the T1082: System Information Discovery technique to determine their next course of action. We observe adversaries deploy the highest number of techniques from the TA0005: Defense evasion and TA0007: Discovery tactics. Based on our findings on co-occurrence, we identify six detection, six mitigation strategies, and twelve adversary behaviors. We urge defenders to prioritize primarily the detection of TA0007: Discovery and mitigation of TA0005: Defense evasion techniques. Overall, this study approximates how adversaries leverage techniques based on publicly reported documents. We advocate organizations investigate adversarial techniques in their environment and make the findings available for a more precise and actionable understanding.


title: Depth and Representation in Vision Models

abstract: Deep learning models develop successive representations of their input in sequential layers, the last of which maps the final representation to the output. Here we investigate the informational content of these representations by observing the ability of convolutional image classification models to autoencode the model's input using embeddings existing in various layers. We find that the deeper the layer, the less accurate that layer's representation of the input is before training. Inaccurate representation results from non-uniqueness in which various distinct inputs give approximately the same embedding. Non-unique representation is a consequence of both exact and approximate non-invertibility of transformations present in the forward pass. Learning to classify natural images leads to an increase in representation clarity for early but not late layers, which instead form abstract images. Rather than simply selecting for features present in the input necessary for classification, deep layer representations are found to transform the input so that it matches representations of the training data such that arbitrary inputs are mapped to manifolds learned during training. This work provides support for the theory that the tasks of image recognition and input generation are inseparable even for models trained exclusively to classify.


title: Generating $k$ EPR-pairs from an $n$-party resource state

abstract: Motivated by quantum network applications over classical channels, we initiate the study of $n$-party resource states from which LOCC protocols can create EPR-pairs between any $k$ disjoint pairs of parties. We give constructions of such states where $k$ is not too far from the optimal $n/2$ while the individual parties need to hold only a constant number of qubits. In the special case when each party holds only one qubit, we describe a family of $n$-qubit states with $k$ proportional to $\log n$ based on Reed-Muller codes, as well as small numerically found examples for $k=2$ and $k=3$. We also prove some lower bounds, for example showing that if $k=n/2$ then the parties must have at least $\Omega(\log\log n)$ qubits each.


title: Ubiquitous light real-space pairing from long-range hopping and interactions

abstract: We systematically examine how long-range hopping and its synergy with extended interactions leads to light bound pairs. Pair properties are determined for a dilute extended Hubbard model with large on-site repulsion ($U$) and both near- and next-nearest neighbour hopping ($t$ and $t'$) and attraction ($V$ and $V'$), for cubic and tetragonal lattices. The presence of $t'$ and $V'$ promotes light pairs. For tetragonal lattices, $t'<0$ pairs can be lighter than non-interacting particles, and $d$-symmetric pairs form. Close packing transition temperatures, $T^{\ast}$ are estimated for the Bose-Einstein condensation (BEC) of pairs to be $k_{B}T^{\ast}\sim\overline{t} 0.1$, where $\overline{t}$ is the geometric mean of the hoppings on the Cartesian axes. When pairs have $d$-symmetry, the condensate has $d$-wave character. Thus, the presence of both $t'$ and $V'$ leads ubiquitously to small strongly bound pairs with an inverse mass that is linear in hopping, which could lead to high temperature BECs.


title: Social Construction of XAI: Do We Need One Definition to Rule Them All?

abstract: There is a growing frustration amongst researchers and developers in Explainable AI (XAI) around the lack of consensus around what is meant by 'explainability'. Do we need one definition of explainability to rule them all? In this paper, we argue why a singular definition of XAI is neither feasible nor desirable at this stage of XAI's development. We view XAI through the lenses of Social Construction of Technology (SCOT) to explicate how diverse stakeholders (relevant social groups) have different interpretations (interpretative flexibility) that shape the meaning of XAI. Forcing a standardization (closure) on the pluralistic interpretations too early can stifle innovation and lead to premature conclusions. We share how we can leverage the pluralism to make progress in XAI without having to wait for a definitional consensus.


title: An investigation of security controls and MITRE ATT\&CK techniques

abstract: Attackers utilize a plethora of adversarial techniques in cyberattacks to compromise the confidentiality, integrity, and availability of the target organizations and systems. Information security standards such as NIST, ISO/IEC specify hundreds of security controls that organizations can enforce to protect and defend the information systems from adversarial techniques. However, implementing all the available controls at the same time can be infeasible and security controls need to be investigated in terms of their mitigation ability over adversarial techniques used in cyberattacks as well. The goal of this research is to aid organizations in making informed choices on security controls to defend against cyberthreats through an investigation of adversarial techniques used in current cyberattacks. In this study, we investigated the extent of mitigation of 298 NIST SP800-53 controls over 188 adversarial techniques used in 669 cybercrime groups and malware cataloged in the MITRE ATT\&CK framework based upon an existing mapping between the controls and techniques. We identify that, based on the mapping, only 101 out of 298 control are capable of mitigating adversarial techniques. However, we also identify that 53 adversarial techniques cannot be mitigated by any existing controls, and these techniques primarily aid adversaries in bypassing system defense and discovering targeted system information. We identify a set of 20 critical controls that can mitigate 134 adversarial techniques, and on average, can mitigate 72\% of all techniques used by 98\% of the cataloged adversaries in MITRE ATT\&CK. We urge organizations, that do not have any controls enforced in place, to implement the top controls identified in the study.


title: Completely Integrable Replicator Dynamics Associated to Competitive Networks

abstract: The replicator equations are a family of ordinary differential equations that arise in evolutionary game theory, and are closely related to Lotka-Volterra. We produce an infinite family of replicator equations which are Liouville-Arnold integrable. We show this by explicitly providing conserved quantities and a Poisson structure. As a corollary, we classify all tournament replicators up to dimension 6 and most of dimension 7. As an application, we show that Fig. 1 of ``A competitive network theory of species diversity" by Allesina and Levine (Proc. Natl. Acad. Sci., 2011), produces quasiperiodic dynamics.


title: Self-Supervised Isotropic Superresolution Fetal Brain MRI

abstract: Superresolution T2-weighted fetal-brain magnetic-resonance imaging (FBMRI) traditionally relies on the availability of several orthogonal low-resolution series of 2-dimensional thick slices (volumes). In practice, only a few low-resolution volumes are acquired. Thus, optimization-based image-reconstruction methods require strong regularization using hand-crafted regularizers (e.g., TV). Yet, due to in utero fetal motion and the rapidly changing fetal brain anatomy, the acquisition of the high-resolution images that are required to train supervised learning methods is difficult. In this paper, we sidestep this difficulty by providing a proof of concept of a self-supervised single-volume superresolution framework for T2-weighted FBMRI (SAIR). We validate SAIR quantitatively in a motion-free simulated environment. Our results for different noise levels and resolution ratios suggest that SAIR is comparable to multiple-volume superresolution reconstruction methods. We also evaluate SAIR qualitatively on clinical FBMRI data. The results suggest SAIR could be incorporated into current reconstruction pipelines.


title: Multi-scale description of pedestrian collective dynamics with port-Hamiltonian systems

abstract: Port-Hamiltonian systems (PHS) theory is a recent but already well-established modelling approach for non-linear physical systems. Some studies have shown lately that PHS frameworks are relevant for modelling and control of swarm and multi-agent systems. We identify in this contribution a general class of microscopic force-based pedestrian models that can be formulated as a port-Hamiltonian system. The pedestrian PHS has linear structure and dissipation components. Non-linear effects come from isotropic pedestrian interactions. Simulation results on a torus with disordered initial states show that the port-Hamiltonian pedestrian model can exhibit different types of dynamics. They range from relaxed speed models with no interaction, dynamical billiards, or crystallization dynamics to realistic pedestrian collective behaviors, including lane and strip formation for counter and crossing flow. The port-Hamiltonian framework is a natural multiscale description of pedestrian dynamics as the Hamiltonian turns out to be a generic order parameter that allows us to identify specific behaviours of the dynamics from a macroscopic viewpoint. Particular cases even enable through energy balance to determine the Hamiltonian behavior without requiring the tedious computation of the microscopic dynamics. Using PHS theory, we systematically identify a critical threshold value for the Hamiltonian, which relies only on exogenous input and can be physically interpreted.


title: Proofs of McIntosh's Conjecture on Franel Integrals and Two Generalizations

abstract: We provide a proof of a conjecture made by Richard McIntosh in 1996 on the values of the Franel integrals, $$\int_0^1((ax))((bx))((cx))((ex))\,dx,$$ where $((x))$ is the first periodic Bernoulli function. Secondly, we extend our ideas to prove a similar theorem for $$\int_0^1((a_1x))((a_2x))\cdots ((a_{n}x))\,dx.$$ Lastly, we prove a further generalization in which $((x))$ is replaced by any particular Bernoulli function with odd index.


title: A time-consistent stabilized finite element method for fluids with applications to hemodynamics

abstract: Several finite element methods for simulating incompressible flows rely on the streamline upwind Petrov-Galerkin stabilization (SUPG) term, which is weighted by tau_SUPG. The conventional formulation of tau_SUPG includes a constant that depends on the time step size, producing an overall method that becomes exceedingly less accurate as the time step size approaches zero. In practice, such method inconsistency introduces significant error in the solution, especially in cardiovascular simulations, where small time step sizes may be required. To overcome this issue, we propose a consistent method that is based on a new definition of tau_SUPG. This method, which can be easily implemented on top of an existing streamline upwind Petrov-Galerkin and pressure stabilizing Petrov-Galerkin method, involves the replacement of the time step size in tau_SUPG with a physical time scale. This time scale is calculated in a simple operation once every time step for the entire computational domain from the ratio of the L2-norm of the acceleration and the velocity. The proposed method is compared against the conventional method using four cases: a steady pipe flow, a blood flow through vascular anatomy, an external flow over a square obstacle, and a fluid-structure interaction case. These numerical experiments show that the proposed formulation eliminates the inconsistency issue associated with the conventional formulation in all cases. While the proposed method is slightly more costly than the conventional method, it significantly reduces the error, particularly at small time step sizes. For the pipe flow where an exact solution is available, we show the conventional method can over-predict the pressure drop by a factor of three. This large error is almost completely eliminated by the proposed formulation, dropping to approximately 1% for all time step sizes and Reynolds numbers considered.


title: Spectral Evolution and Invariance in Linear-width Neural Networks

abstract: We investigate the spectral properties of linear-width feed-forward neural networks, where the sample size is asymptotically proportional to network width. Empirically, we show that the spectra of weight in this high dimensional regime are invariant when trained by gradient descent for small constant learning rates; we provide a theoretical justification for this observation and prove the invariance of the bulk spectra for both conjugate and neural tangent kernels. We demonstrate similar characteristics when training with stochastic gradient descent with small learning rates. When the learning rate is large, we exhibit the emergence of an outlier whose corresponding eigenvector is aligned with the training data structure. We also show that after adaptive gradient training, where a lower test error and feature learning emerge, both weight and kernel matrices exhibit heavy tail behavior. Simple examples are provided to explain when heavy tails can have better generalizations. We exhibit different spectral properties such as invariant bulk, spike, and heavy-tailed distribution from a two-layer neural network using different training strategies, and then correlate them to the feature learning. Analogous phenomena also appear when we train conventional neural networks with real-world data. We conclude that monitoring the evolution of the spectra during training is an essential step toward understanding the training dynamics and feature learning.


title: WindowSHAP: An Efficient Framework for Explaining Time-series Classifiers based on Shapley Values

abstract: Unpacking and comprehending how black-box machine learning algorithms make decisions has been a persistent challenge for researchers and end-users. Explaining time-series predictive models is useful for clinical applications with high stakes to understand the behavior of prediction models. However, existing approaches to explain such models are frequently unique to data where the features do not have a time-varying component. In this paper, we introduce WindowSHAP, a model-agnostic framework for explaining time-series classifiers using Shapley values. We intend for WindowSHAP to mitigate the computational complexity of calculating Shapley values for long time-series data as well as improve the quality of explanations. WindowSHAP is based on partitioning a sequence into time windows. Under this framework, we present three distinct algorithms of Stationary, Sliding and Dynamic WindowSHAP, each evaluated against baseline approaches, KernelSHAP and TimeSHAP, using perturbation and sequence analyses metrics. We applied our framework to clinical time-series data from both a specialized clinical domain (Traumatic Brain Injury - TBI) as well as a broad clinical domain (critical care medicine). The experimental results demonstrate that, based on the two quantitative metrics, our framework is superior at explaining clinical time-series classifiers, while also reducing the complexity of computations. We show that for time-series data with 120 time steps (hours), merging 10 adjacent time points can reduce the CPU time of WindowSHAP by 80% compared to KernelSHAP. We also show that our Dynamic WindowSHAP algorithm focuses more on the most important time steps and provides more understandable explanations. As a result, WindowSHAP not only accelerates the calculation of Shapley values for time-series data, but also delivers more understandable explanations with higher quality.


title: On the robustness of non-intrusive speech quality model by adversarial examples

abstract: It has been shown recently that deep learning based models are effective on speech quality prediction and could outperform traditional metrics in various perspectives. Although network models have potential to be a surrogate for complex human hearing perception, they may contain instabilities in predictions. This work shows that deep speech quality predictors can be vulnerable to adversarial perturbations, where the prediction can be changed drastically by unnoticeable perturbations as small as $-30$ dB compared with speech inputs. In addition to exposing the vulnerability of deep speech quality predictors, we further explore and confirm the viability of adversarial training for strengthening robustness of models.


title: Optimization of waste collection through the sequencing of micro-routes and transfer station convenience analysis: an Argentinian case study

abstract: Municipal solid waste management is a paramount activity in modern cities due to the environmental, social and economic problems that can arise when mishandled. In this work, the sequencing of micro-routes in the Argentine city of Bah\'ia Blanca is addressed, which is modeled as a vehicle routing problem with travel time limit and the vehicle's capacity. Particularly, we propose two mathematical formulations based on mixed-integer programming and we solve a set of instances of the city of Bah\'ia Blanca based on real data. Moreover, with this model we estimate the total distance and travel time of the waste collection and use this data to analyze the possibility of installing a transfer station. The results demonstrate the competitiveness of the approach to resolve realistic instances of the target problem and suggest the convenience of installing a transfer station in the city considering the reduction of the traveled distance.


title: Spatial Organization of Phase-separated DNA Droplets

abstract: Many recent studies of liquid-liquid phase separation in biology focus on phase separation as a dynamic control mechanism for cellular function, but it can also result in complex mesoscopic structures. We primarily investigate a model system consisting of DNA nanostars: finite-valence, self-assembled particles that form micron-scale liquid droplets via a binodal phase transition. We demonstrate that, upon phase separation, nanostar droplets spontaneously form hyperuniform structures, a type of disordered material with `hidden order' that combines the long-range order of crystals with the short-range isotropy of liquids. We find that the hyperuniformity of the DNA droplets reflects near-equilibrium dynamics, where phase separation drives the organization of droplets that then relax toward equilibrium via droplet Brownian motion. We engineer a two-species system of immiscible DNA droplets and find two distinctly hyperuniform structures in the same sample, but with random cross-species droplet correlations, which rules out explanations that rely on droplet-droplet hydrodynamic interactions. In addition, we perform experiments on the electrostatic coacervation of peptides and nucleotides which exhibit hyperuniform structures indistinguishable from DNA nanostars, indicating the phenomenon generally applies to phase-separating systems that experience Brownian motion. Our work on near-equilibrium droplet assembly and structure provides a foundation to investigate droplet organizational mechanisms in driven/biological environments. This approach also provides a clear path to implement phase-separated droplet patterns as exotic optical or mechanical metamaterials, or as efficient biochemical reactors.


title: Defect contrast with 4D-STEM: Understanding crystalline order with virtual detectors and beam modification

abstract: Material properties strongly depend on the nature and concentration of defects. Characterizing these features may require nano- to atomic-scale resolution to establish structure-property relationships. 4D-STEM, a technique where diffraction patterns are acquired at a grid of points on the sample, provides a versatile method for highlighting defects. Computational analysis of the diffraction patterns with virtual detectors produces images that can map material properties. Here, using multislice simulations, we explore different virtual detectors that can be applied to the diffraction patterns that go beyond the binary response functions that are possible using ordinary STEM detectors. Using graphene and lead titanate as model systems, we investigate the application of virtual detectors to study local order and in particular defects. We find that using a small convergence angle with a rotationally varying detector most efficiently highlights defect signals. With experimental graphene data, we demonstrate the effectiveness of these detectors in characterizing atomic features, including vacancies, as suggested in simulations. Phase and amplitude modification of the electron beam provides another process handle to change image contrast in a 4D-STEM experiment. We demonstrate how tailored electron beams can enhance signals from short-range order and how a vortex beam can be used to characterize local symmetry.


title: Stackelberg Meta-Learning Based Control for Guided Cooperative LQG Systems

abstract: Guided cooperation allows intelligent agents with heterogeneous capabilities to work together by following a leader-follower type of interaction. However, the associated control problem becomes challenging when the leader agent does not have complete information about follower agents. There is a need for learning and adaptation of cooperation plans. To this end, we develop a meta-learning-based Stackelberg game-theoretic framework to address the challenges in the guided cooperative control for linear systems. We first formulate the guided cooperation between agents as a dynamic Stackelberg game and use the feedback Stackelberg equilibrium as the agent-wise cooperation strategy. We further leverage meta-learning to address the incomplete information of follower agents, where the leader agent learns a meta-response model from a prescribed set of followers offline and adapts to a new coming cooperation task with a small amount of learning data. We use a case study in robot teaming to corroborate the effectiveness of our framework. Comparison with other learning approaches also shows that our learned cooperation strategy provides better transferability for different cooperation tasks.


title: Stable and Transferable Hyper-Graph Neural Networks

abstract: We introduce an architecture for processing signals supported on hypergraphs via graph neural networks (GNNs), which we call a Hyper-graph Expansion Neural Network (HENN), and provide the first bounds on the stability and transferability error of a hypergraph signal processing model. To do so, we provide a framework for bounding the stability and transferability error of GNNs across arbitrary graphs via spectral similarity. By bounding the difference between two graph shift operators (GSOs) in the positive semi-definite sense via their eigenvalue spectrum, we show that this error depends only on the properties of the GNN and the magnitude of spectral similarity of the GSOs. Moreover, we show that existing transferability results that assume the graphs are small perturbations of one another, or that the graphs are random and drawn from the same distribution or sampled from the same graphon can be recovered using our approach. Thus, both GNNs and our HENNs (trained using normalized Laplacians as graph shift operators) will be increasingly stable and transferable as the graphs become larger. Experimental results illustrate the importance of considering multiple graph representations in HENN, and show its superior performance when transferability is desired.


title: The Master Equation in a Bounded Domain under Invariance Conditions for the State Space

abstract: In this paper, we study the well-posedness (existence and uniqueness) of the Master Equation of Mean Field Games under invariance-type conditions, otherwise known as viability conditions for the controlled dynamics. The interior regularity of the solutions of the associated Mean Field Game system and its linearized version, which plays a crucial role in the proof of the existence, is obtained by the global regularity of the corresponding solutions in the Neumann boundary conditions case. Finally, we prove that the solution of the related Nash system converges to the solution of the Master Equation.


title: Multilevel-in-Layer Training for Deep Neural Network Regression

abstract: A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible solutions so as to discourage overfitting while still enabling good solutions, and different regularization strategies impose different types of restrictions. In this paper, we present a multilevel regularization strategy that constructs and trains a hierarchy of neural networks, each of which has layers that are wider versions of the previous network's layers. We draw intuition and techniques from the field of Algebraic Multigrid (AMG), traditionally used for solving linear and nonlinear systems of equations, and specifically adapt the Full Approximation Scheme (FAS) for nonlinear systems of equations to the problem of deep learning. Training through V-cycles then encourage the neural networks to build a hierarchical understanding of the problem. We refer to this approach as \emph{multilevel-in-width} to distinguish from prior multilevel works which hierarchically alter the depth of neural networks. The resulting approach is a highly flexible framework that can be applied to a variety of layer types, which we demonstrate with both fully-connected and convolutional layers. We experimentally show with PDE regression problems that our multilevel training approach is an effective regularizer, improving the generalize performance of the neural networks studied.


title: Bandits for Online Calibration: An Application to Content Moderation on Social Media Platforms

abstract: We describe the current content moderation strategy employed by Meta to remove policy-violating content from its platforms. Meta relies on both handcrafted and learned risk models to flag potentially violating content for human review. Our approach aggregates these risk models into a single ranking score, calibrating them to prioritize more reliable risk models. A key challenge is that violation trends change over time, affecting which risk models are most reliable. Our system additionally handles production challenges such as changing risk models and novel risk models. We use a contextual bandit to update the calibration in response to such trends. Our approach increases Meta's top-line metric for measuring the effectiveness of its content moderation strategy by 13%.


title: New family of C-metrics in ${\cal N}=2$ gauged supergravity

abstract: We present a new family of charged C-metrics in ${\cal N}=2$ gauged supergravity in four dimensions. The double Wick rotation of the C-metric allows us to bring our solution into a different family of the C-metrics previously found by L\"u and V\'azquez-Poritz. In the case of zero acceleration limit, our solution with vanishing charges reduces to the scalar haired black holes in AdS with regular horizons. Nevertheless, it turns out that each family of neutral solutions fails to veil the curvature singularity by the event horizon, showing that neither of them represents the accelerated black holes with a scalar hair. Physical solutions without visible curvature singularities are obtained only in the case of nonvanishing charges. Causal structures of the solution are spelled out in detail. We also present conditions under which the solution preserves supersymmetry.


title: EOS Manual

abstract: The exoplanet field now abounds with new discoveries of planets and planetary systems. It is of great interest for the scientific community to understand the compositions and internal structures of these new planets outside our own solar system, and then infer their formation scenarios. In particular, the proper implementation of the equation-of-states of various matters into the calculation of internal structure is crucial. Thus, we have come up with this write-up that provides the detailed steps to turn an equation-of-state (EOS) into a mass-radius relation of exoplanets, and highlight the physics and chemistry involved in these calculations. It must be visualized!


title: The Expertise Problem: Learning from Specialized Feedback

abstract: Reinforcement learning from human feedback (RLHF) is a powerful technique for training agents to perform difficult-to-specify tasks. However, human feedback can be noisy, particularly when human teachers lack relevant knowledge or experience. Levels of expertise vary across teachers, and a given teacher may have differing levels of expertise for different components of a task. RLHF algorithms that learn from multiple teachers therefore face an expertise problem: the reliability of a given piece of feedback depends both on the teacher that it comes from and how specialized that teacher is on relevant components of the task. Existing state-of-the-art RLHF algorithms assume that all evaluations come from the same distribution, obscuring this inter- and intra-human variance, and preventing them from accounting for or taking advantage of variations in expertise. We formalize this problem, implement it as an extension of an existing RLHF benchmark, evaluate the performance of a state-of-the-art RLHF algorithm, and explore techniques to improve query and teacher selection. Our key contribution is to demonstrate and characterize the expertise problem, and to provide an open-source implementation for testing future solutions.


title: Quantum Statistical Mechanics via Boundary Conditions. A Groupoid Approach to Quantum Spin Systems

abstract: We use a groupoid model for the spin algebra to introduce boundary conditions on quantum spin systems via a Poisson point process representation. We can describe KMS states of quantum systems by means of a set of equations resembling the standard DLR equations of classical statistical mechanics. We introduce a notion of quantum specification which recovers the classical DLR measures in the particular case of classical interactions. Our results are in the same direction as those obtained recently by Cha, Naaijkens, and Nachtergaele, differently somehow from the predicted by Fannes and Werner.

categories: math-ph cond-mat.stat-mech math.MP math.OA


title: On maximal k-edge-connected subgraphs of undirected graphs

abstract: We show how to find and efficiently maintain maximal k-edge-connected subgraphs in undirected graphs. In particular, we provide the following results. (1) A general framework for maintaining the maximal k-edge-connected subgraphs upon insertions of edges or vertices, by successively partitioning the graph into its k-edge-connected components. This defines a decomposition tree, which can be maintained by using algorithms for the incremental maintenance of the k-edge-connected components as black boxes at every level of the tree. (2) As an application of this framework, we provide two algorithms for the incremental maintenance of the maximal $3$-edge-connected subgraphs. These algorithms allow for vertex and edge insertions, interspersed with queries asking whether two vertices belong to the same maximal $3$-edge-connected subgraph. The first algorithm has $O(m\alpha(m,n) + n^2\log^2 n)$ total running time and uses $O(n)$ space, where $m$ is the number of edge insertions and queries, and $n$ is the total number of vertices inserted. The second algorithm performs the same operations in faster $O(m\alpha(m,n) + n^2\alpha(n,n))$ time in total, using $O(n^2)$ space. (3) We provide efficient constructions of sparse subgraphs that have the same maximal k-edge-connected subgraphs as the original graph. These are useful in speeding up computations involving the maximal k-edge-connected subgraphs in dense undirected graphs. (4) We give two deterministic algorithms for computing the maximal k-edge-connected subgraphs in undirected graphs, with running times $O(m+k^{O(1)}n\sqrt{n}\mathrm{polylog}(n))$ and $O(m+k^{O(k)}n\sqrt{n}\log{n})$, respectively. (5) A fully dynamic algorithm for maintaining information about the maximal k-edge-connected subgraphs for fixed k. Our update bounds are $O(n\sqrt{n}\log{n})$ worst-case time, and we achieve constant time for maximal k-edge-connected subgraph queries.


title: Deep Learning Generates Synthetic Cancer Histology for Explainability and Education

abstract: Artificial intelligence methods including deep neural networks (DNN) can provide rapid molecular classification of tumors from routine histology with accuracy that matches or exceeds human pathologists. Discerning how neural networks make their predictions remains a significant challenge, but explainability tools help provide insights into what models have learned when corresponding histologic features are poorly defined. Here, we present a method for improving explainability of DNN models using synthetic histology generated by a conditional generative adversarial network (cGAN). We show that cGANs generate high-quality synthetic histology images that can be leveraged for explaining DNN models trained to classify molecularly-subtyped tumors, exposing histologic features associated with molecular state. Fine-tuning synthetic histology through class and layer blending illustrates nuanced morphologic differences between tumor subtypes. Finally, we demonstrate the use of synthetic histology for augmenting pathologist-in-training education, showing that these intuitive visualizations can reinforce and improve understanding of histologic manifestations of tumor biology.


title: Realization of two-qutrit quantum algorithms on a programmable superconducting processor

abstract: Processing quantum information using quantum three-level systems or qutrits as the fundamental unit is an alternative to contemporary qubit-based architectures with the potential to provide significant computational advantages. We demonstrate a fully programmable two-qutrit quantum processor by utilizing the third energy eigenstates of two transmons. We develop a parametric coupler to achieve excellent connectivity in the nine-dimensional Hilbert space enabling efficient implementations of two-qutrit gates. We characterize our processor by realizing several algorithms like Deutsch-Jozsa, Bernstein-Vazirani, and Grover's search. Our efficient ancilla-free protocols allow us to show that two stages of Grover's amplification can improve the success rates of an unstructured search with quantum advantage. Our results pave the way for building fully programmable ternary quantum processors using transmons as building blocks for a universal quantum computer.


title: Quantum Split Neural Network Learning using Cross-Channel Pooling

abstract: In recent years, the field of quantum science has attracted significant interest across various disciplines, including quantum machine learning, quantum communication, and quantum computing. Among these emerging areas, quantum federated learning (QFL) has gained particular attention due to the integration of quantum neural networks (QNNs) with traditional federated learning (FL) techniques. In this study, a novel approach entitled quantum split learning (QSL) is presented, which represents an advanced extension of classical split learning. Previous research in classical computing has demonstrated numerous advantages of split learning, such as accelerated convergence, reduced communication costs, and enhanced privacy protection. To maximize the potential of QSL, cross-channel pooling is introduced, a technique that capitalizes on the distinctive properties of quantum state tomography facilitated by QNNs. Through rigorous numerical analysis, evidence is provided that QSL not only achieves a 1.64\% higher top-1 accuracy compared to QFL but also demonstrates robust privacy preservation in the context of the MNIST classification task.


title: Actionable Recourse via GANs for Mobile Health

abstract: Mobile health apps provide a unique means of collecting data that can be used to deliver adaptive interventions.The predicted outcomes considerably influence the selection of such interventions. Recourse via counterfactuals provides tangible mechanisms to modify user predictions. By identifying plausible actions that increase the likelihood of a desired prediction, stakeholders are afforded agency over their predictions. Furthermore, recourse mechanisms enable counterfactual reasoning that can help provide insights into candidates for causal interventional features. We demonstrate the feasibility of GAN-generated recourse for mobile health applications on ensemble-survival-analysis-based prediction of medium-term engagement in the Safe Delivery App, a digital training tool for skilled birth attendants.


title: Data-driven optimization for Air Traffic Flow Management with trajectory preferences

abstract: In this paper, we present a novel data-driven optimization approach for trajectory based air traffic flow management (ATFM). A key aspect of the proposed approach is the inclusion of airspace users' trajectory preferences, which are computed from traffic data by combining clustering and classification techniques. Machine learning is also used to extract consistent trajectory options, while optimization is applied to resolve demand-capacity imbalances by means of a mathematical programming model that judiciously assigns a feasible 4D trajectory and a possible ground delay to each flight. The methodology has been tested on instances extracted from real air traffic data repositories. With more than 32,000 flights considered, we solve the largest instances of the ATFM problem available in the literature in short computational times that are reasonable from the practical point of view. As a by-product, we highlight the trade-off between preferences and delays as well as the potential benefits. Indeed, computing efficient solutions of the problem facilitates a consensus between network manager and airspace users. In view of the level of accuracy of the solutions and of the excellent computational performance, we are optimistic that the proposed approach may provide a significant contribution to the development of the next generation of air traffic flow management tools.


title: Rewards Encoding Environment Dynamics Improves Preference-based Reinforcement Learning

abstract: Preference-based reinforcement learning (RL) algorithms help avoid the pitfalls of hand-crafted reward functions by distilling them from human preference feedback, but they remain impractical due to the burdensome number of labels required from the human, even for relatively simple tasks. In this work, we demonstrate that encoding environment dynamics in the reward function (REED) dramatically reduces the number of preference labels required in state-of-the-art preference-based RL frameworks. We hypothesize that REED-based methods better partition the state-action space and facilitate generalization to state-action pairs not included in the preference dataset. REED iterates between encoding environment dynamics in a state-action representation via a self-supervised temporal consistency task, and bootstrapping the preference-based reward function from the state-action representation. Whereas prior approaches train only on the preference-labelled trajectory pairs, REED exposes the state-action representation to all transitions experienced during policy training. We explore the benefits of REED within the PrefPPO [1] and PEBBLE [2] preference learning frameworks and demonstrate improvements across experimental conditions to both the speed of policy learning and the final policy performance. For example, on quadruped-walk and walker-walk with 50 preference labels, REED-based reward functions recover 83% and 66% of ground truth reward policy performance and without REED only 38\% and 21\% are recovered. For some domains, REED-based reward functions result in policies that outperform policies trained on the ground truth reward.


title: Evaporation of binary liquids from a capillary tube

abstract: Evaporation of multi-component liquid mixtures in confined geometries, such as capillaries, is crucial in applications such as microfluidics, two-phase cooling devices, and inkjet printing. Predicting the behaviour of such systems becomes challenging because evaporation triggers complex spatio-temporal changes in the composition of the mixture. These changes in composition, in turn, affect evaporation. In the present work, we study the evaporation of aqueous glycerol solutions contained as a liquid column in a capillary tube. Experiments and direct numerical simulations show three evaporation regimes characterised by different temporal evolutions of the normalised mass transfer rate (or Sherwood number, $Sh$), namely $Sh (\tilde{t}) = 1$, $Sh \sim 1/\sqrt{\tilde{t}}$, and $Sh \sim \exp\left(-\tilde{t}\right)$. Here $\tilde{t}$ is a normalised time. We present a simplistic analytical model which shows that the evaporation dynamics can be expressed by the classical relation $Sh = \exp \left( \tilde{t} \right) \mathrm{erfc} \left( \sqrt{\tilde{t}}\right)$. For small and medium $\tilde{t}$, this expression results in the first and second of the three observed scaling regimes, respectively. This analytical model is formulated in the limit of pure diffusion and when the penetration depth $\delta(t)$ of the diffusion front is much smaller than the length $L(t)$ of the liquid column. When $\delta \approx L$, finite length effects lead to $Sh \sim \exp\left(-\tilde{t}\right)$, i.e. the third regime. Finally, we extend our analytical model to incorporate the effect of advection and determine the conditions under which this effect is important. Our results provide fundamental insight into the physics of selective evaporation from a multi-component liquid column.


title: Solar Orbiter and SDO Observations, and Bifrost MHD Simulations of Small-scale Coronal Jets

abstract: We report high-resolution, high-cadence observations of five small-scale coronal jets in an on-disk quiet Sun region observed with Solar Orbiter's EUI/\hri\ in 174 \AA. We combine the \hri\ images with the EUV images of SDO/AIA and investigate magnetic setting of the jets using co-aligned line-of-sight magnetograms from SDO/HMI. The \hri\ jets are miniature versions of typical coronal jets as they show narrow collimated spires with a base brightening. Three out of five jets result from a detectable minifilament eruption following flux cancelation at the neutral line under the minifilament, analogous to coronal jets. To better understand the physics of jets, we also analyze five small-scale jets from a high-resolution Bifrost MHD simulation in synthetic \FeIX/\FeX\ emissions. The jets in the simulation reside above neutral lines and four out of five jets are triggered by magnetic flux cancelation. The temperature maps show the evidence of cool gas in the same four jets. Our simulation also shows the signatures of opposite Doppler shifts (of the order of $\pm$10s of \kms) in the jet spire, which is evidence of untwisting motion of the magnetic field in the jet spire. The average jet duration, spire length, base width, and speed in our observations (and in synthetic \FeIX/\FeX\ images) are 6.5$\pm$4.0 min (9.0$\pm$4.0 min), 6050$\pm$2900 km (6500$\pm$6500 km), 2200$\pm$850 km, (3900$\pm$2100 km), and 60$\pm$8 \kms\ (42$\pm$20 \kms), respectively. Our observation and simulation results provide a unified picture of small-scale solar coronal jets driven by magnetic reconnection accompanying flux cancelation. This picture also aligns well with the most recent reports of the formation and eruption mechanisms of larger coronal jets.


title: Multi-Epoch Matrix Factorization Mechanisms for Private Machine Learning

abstract: We introduce new differentially private (DP) mechanisms for gradient-based machine learning (ML) with multiple passes (epochs) over a dataset, substantially improving the achievable privacy-utility-computation tradeoffs. We formalize the problem of DP mechanisms for adaptive streams with multiple participations and introduce a non-trivial extension of online matrix factorization DP mechanisms to our setting. This includes establishing the necessary theory for sensitivity calculations and efficient computation of optimal matrices. For some applications like $>\!\! 10,000$ SGD steps, applying these optimal techniques becomes computationally expensive. We thus design an efficient Fourier-transform-based mechanism with only a minor utility loss. Extensive empirical evaluation on both example-level DP for image classification and user-level DP for language modeling demonstrate substantial improvements over all previous methods, including the widely-used DP-SGD . Though our primary application is to ML, our main DP results are applicable to arbitrary linear queries and hence may have much broader applicability.


title: Noise-specific beats in the higher-level Ramsey curves of a transmon qubit

abstract: In the higher levels of superconducting transmon devices, and more generally charge sensitive devices, $T_2^*$ measurements made in the presence of low-frequency time-correlated $1/f$ charge noise and quasiparticle-induced parity flips can give an underestimation of the total dephasing time. The charge variations manifest as beating patterns observed in the overlay of several Ramsey fringe curves, and are reproduced with a phenomenological Ramsey curve model which accounts for the charge variations. $T_2^*$ dephasing times which more accurately represent the total dephasing time are obtained. The phenomenological model is compared with a Lindblad master equation model. Both models are found to be in agreement with one another and the experimental data. Finally, the phenomenological formulation enables a simple method in which the power spectral density (PSD) for the low-frequency noise can be inferred from the overlay of several Ramsey curves.


title: Energy nonconservation and relativistic trajectories: Unimodular gravity and beyond

abstract: Energy conservation has the status of a fundamental physical principle. However, measurements in quantum mechanics do not comply with energy conservation. Therefore, it is expected that a more fundamental theory of gravity -- one that is less incompatible with quantum mechanics -- should admit energy nonconservations. This paper begins by identifying the conditions for a theory to have an energy-momentum tensor that is not conserved. Then, the trajectory equation for pointlike particles that lose energy is derived, showing that energy nonconservation produces a particular acceleration. As an example, the unimodular theory of gravity is studied. Interestingly, in spherical symmetry, given that there is a generalized Birkhoff theorem and that the energy-momentum tensor divergence is a closed form, the trajectories of test particles that lose energy can be found using well known methods. Finally, limits on the energy nonconservation parameters are set using Solar system observations.


title: Adaptive Joint Estimation of Temporal Vertex and Edge Signals

abstract: The adaptive estimation of coexisting temporal vertex (node) and edge signals on graphs is a critical task when a change in edge signals influences the temporal dynamics of the vertex signals. However, the current Graph Signal Processing algorithms mostly consider only the signals existing on the graph vertices and have neglected the fact that signals can reside on the edges. We propose an Adaptive Joint Vertex-Edge Estimation (AJVEE) algorithm for jointly estimating time-varying vertex and edge signals through a time-varying regression, incorporating both vertex signal filtering and edge signal filtering. Accompanying AJVEE is a newly proposed Adaptive Least Mean Square procedure based on the Hodge Laplacian (ALMS-Hodge), which is inspired by classical adaptive filters combining simplicial filtering and simplicial regression. AJVEE is able to operate jointly on the vertices and edges by merging two ALMS-Hodge algorithms specified on the vertices and edges into a unified formulation. A more generalized case extending AJVEE beyond the vertices and edges is being discussed. Experimenting on real-world traffic networks and population mobility networks, we have confirmed that our proposed AJVEE algorithm could accurately and jointly track time-varying vertex and edge signals on graphs.


title: Beyond Fisher Forecasting for Cosmology

abstract: The planning and design of future experiments rely heavily on forecasting to assess the potential scientific value provided by a hypothetical set of measurements. The Fisher information matrix, due to its convenient properties and low computational cost, provides an especially useful forecasting tool. However, the Fisher matrix only provides a reasonable approximation to the true likelihood when data are nearly Gaussian distributed and observables have nearly linear dependence on the parameters of interest. Also, Fisher forecasting techniques alone cannot be used to assess their own validity. Thorough sampling of the exact or mock likelihood can definitively determine whether a Fisher forecast is valid, though such sampling is often prohibitively expensive. We propose a simple test, based on the Derivative Approximation for LIkelihoods (DALI) technique, to determine whether the Fisher matrix provides a good approximation to the exact likelihood. We show that the Fisher matrix becomes a poor approximation to the true likelihood in regions where two-dimensional slices of level surfaces of the DALI approximation to the likelihood differ from two-dimensional slices of level surfaces of the Fisher approximation to the likelihood. We demonstrate that our method accurately predicts situations in which the Fisher approximation deviates from the true likelihood for various cosmological models and several data combinations, with only a modest increase in computational cost compared to standard Fisher forecasts.


title: A unified one-shot prosody and speaker conversion system with self-supervised discrete speech units

abstract: We present a unified system to realize one-shot voice conversion (VC) on the pitch, rhythm, and speaker attributes. Existing works generally ignore the correlation between prosody and language content, leading to the degradation of naturalness in converted speech. Additionally, the lack of proper language features prevents these systems from accurately preserving language content after conversion. To address these issues, we devise a cascaded modular system leveraging self-supervised discrete speech units as language representation. These discrete units provide duration information essential for rhythm modeling. Our system first extracts utterance-level prosody and speaker representations from the raw waveform. Given the prosody representation, a prosody predictor estimates pitch, energy, and duration for each discrete unit in the utterance. A synthesizer further reconstructs speech based on the predicted prosody, speaker representation, and discrete units. Experiments show that our system outperforms previous approaches in naturalness, intelligibility, speaker transferability, and prosody transferability. Code and samples are publicly available.


title: Improving the Efficiency of the PC Algorithm by Using Model-Based Conditional Independence Tests

abstract: Learning causal structure is useful in many areas of artificial intelligence, including planning, robotics, and explanation. Constraint-based structure learning algorithms such as PC use conditional independence (CI) tests to infer causal structure. Traditionally, constraint-based algorithms perform CI tests with a preference for smaller-sized conditioning sets, partially because the statistical power of conventional CI tests declines rapidly as the size of the conditioning set increases. However, many modern conditional independence tests are model-based, and these tests use well-regularized models that maintain statistical power even with very large conditioning sets. This suggests an intriguing new strategy for constraint-based algorithms which may result in a reduction of the total number of CI tests performed: Test variable pairs with large conditioning sets first, as a pre-processing step that finds some conditional independencies quickly, before moving on to the more conventional strategy that favors small conditioning sets. We propose such a pre-processing step for the PC algorithm which relies on performing CI tests on a few randomly selected large conditioning sets. We perform an empirical analysis on directed acyclic graphs (DAGs) that correspond to real-world systems and both empirical and theoretical analyses for Erd\H{o}s-Renyi DAGs. Our results show that Pre-Processing Plus PC (P3PC) performs far fewer CI tests than the original PC algorithm, between 0.5% to 36%, and often less than 10%, of the CI tests that the PC algorithm alone performs. The efficiency gains are particularly significant for the DAGs corresponding to real-world systems.


title: Back-to-the-Future Whois: An IP Address Attribution Service for Working with Historic Datasets

abstract: Researchers and practitioners often face the issue of having to attribute an IP address to an organization. For current data this is comparably easy, using services like whois or other databases. Similarly, for historic data, several entities like the RIPE NCC provide websites that provide access to historic records. For large-scale network measurement work, though, researchers often have to attribute millions of addresses. For current data, Team Cymru provides a bulk whois service which allows bulk address attribution. However, at the time of writing, there is no service available that allows historic bulk attribution of IP addresses. Hence, in this paper, we introduce and evaluate our 'Back-to-the-Future whois' service, allowing historic bulk attribution of IP addresses on a daily granularity based on CAIDA Routeviews aggregates. We provide this service to the community for free, and also share our implementation so researchers can run instances themselves.


title: A Supertranslation-Invariant Formula for the Angular Momentum Flux in Gravitational Scattering

abstract: The angular momentum radiated in gravitational scattering can be changed by performing a supertranslation of the asymptotic metric, i.e. by adding radiation with infinite wavelenght to the metric. This puzzling property can be avoided by adopting a supertranslation-invariant definition of the angular momentum flux in general relativity. Definitions currently available in the literature cannot reproduce the flux necessary to obtain the correct radiation reaction effects in gravitational scattering. They also disagree with computations of the flux performed using scattering amplitudes and soft graviton theorems. In this paper we provide a new supertranslation-invariant definition of the angular momentum flux in gravitational scattering that uses only asymptotic metric data and reproduces the flux necessary to obtain the correct radiation reaction effects.


title: Unbounded quantum backflow in two dimensions

abstract: Quantum backflow refers to the counterintuitive fact that the probability can flow in the direction opposite to the momentum of a quantum particle. This phenomenon has been seen to be small and fragile for one-dimensional systems, in which the maximal amount of backflow has been found to be bounded. Quantum backflow exhibits dramatically different features in two-dimensional systems that, contrary to the one-dimensional case, allow for degenerate energy eigenstates. Here we investigate the case of a charged particle that is confined to move on a finite disk punctured at the center and that is pierced through the center, and normally to the disk, by a magnetic flux line. We demonstrate that quantum backflow can be unbounded (in a certain sense), which makes this system a promising physical platform regarding the yet-to-be-performed experimental observation of this fundamental quantum phenomenon.


title: Seymour's Second Neighborhood Conjecture for orientations of (pseudo)random graphs

abstract: Seymour's Second Neighborhood Conjecture (SNC) states that every oriented graph contains a vertex whose second neighborhood is as large as its first neighborhood. We investigate the SNC for orientations of both binomial and pseudo random graphs, verifying the SNC asymptotically almost surely (a.a.s.) (i) for all orientations of $G(n,p)$ if $\limsup_{n\to\infty} p < 1/4$; and (ii) for a uniformly-random orientation of each weakly $(p,A\sqrt{np})$-bijumbled graph of order $n$ and density $p$, where $p=\Omega(n^{-1/2})$ and $1-p = \Omega(n^{-1/6})$ and $A>0$ is a universal constant independent of both $n$ and $p$. We also show that a.a.s. the SNC holds for almost every orientation of $G(n,p)$. More specifically, we prove that a.a.s. (iii) for all $\varepsilon > 0$ and $p=p(n)$ with $\limsup_{n\to\infty} p \le 2/3-\varepsilon$, every orientation of $G(n,p)$ with minimum outdegree $\Omega_\varepsilon(\sqrt{n})$ satisfies the SNC; and (iv) for all $p=p(n)$, a random orientation of $G(n,p)$ satisfies the SNC.


title: Emission Modeling in the EHT-ngEHT Age

abstract: This work proposes a methodology to test phenomenologically-motivated emission processes that account for the flux and polarization distribution and global structure of the 230 GHz sources imaged by the Event Horizon Telescope (EHT): Messier (M)87* and Sagittarius (Sgr) A*. We introduce to general relativistic magnetohydrodynamic (GRMHD) simulations some novel models to bridge the largely uncertain mechanisms by which high-energy particles in jet/accretion flow/black hole (JAB) system plasmas attain billion degree temperatures and emit synchrotron radiation. The "Observing" JAB Systems methodology then partitions the simulation to apply different parametric models to regions governed by different plasma physics -- an advance over methods where one parametrization is used over simulation regions spanning thousands of gravitational radii from the central supermassive black hole. We present several classes of viewing-angle dependent morphologies, and highlight signatures of piecewise modeling and positron effects -- including a MAD/SANE dichotomy in which polarized maps appear dominated by intrinsic polarization in the MAD case and by Faraday effects in the SANE case. The library of images thus produced spans a wide range of morphologies awaiting discovery by the groundbreaking EHT instrument and its yet more sensitive, higher resolution next-generation counterpart ngEHT.


title: Detailed Calculations of the Efficiency of Planetesimal Accretion in the Core-Accretion Model -II: The effect of Saturn

abstract: As part of our ongoing initiative on accurately calculating the accretion rate of planetesimals in the core-accretion model, we demonstrated in a recent article that when the calculations include the gravitational force of the Sun (the original core-accretion model did not include solar gravity), results change considerably [ApJ, 899:45]. In this paper, we have advanced our previous study by including the effect of Saturn. To maintain focus on the effect of this planet, and in order to be consistent with previous studies, we did not include the effect of the nebular gas. Results demonstrated that as expected, Saturn's perturbation decreases the rate of accretion by scattering many planetesimals out of Jupiter's accretion zone. It also increases the velocities with which planetesimals encounter the envelope, which in agreement with our previous findings, enhances their break-up due to the ram-pressure. Results also show that, because the effect of Saturn in scattering of planetesimals increases with its mass, this planet might not have played a significant role in the accretion of planetesimals by proto-Jupiter during the early stage of its growth. Finally, the late accretion of planetesimals, as obtained in our previous study, appears in our new results as well, implying that combined with the rapid in-fall of the gas, it can result in the mixing of material in the outer regions of the envelope which may explain the enhancement of the envelope's high-Z material.


title: Dark patterns in e-commerce: a dataset and its baseline evaluations

abstract: Dark patterns, which are user interface designs in online services, induce users to take unintended actions. Recently, dark patterns have been raised as an issue of privacy and fairness. Thus, a wide range of research on detecting dark patterns is eagerly awaited. In this work, we constructed a dataset for dark pattern detection and prepared its baseline detection performance with state-of-the-art machine learning methods. The original dataset was obtained from Mathur et al.'s study in 2019, which consists of 1,818 dark pattern texts from shopping sites. Then, we added negative samples, i.e., non-dark pattern texts, by retrieving texts from the same websites as Mathur et al.'s dataset. We also applied state-of-the-art machine learning methods to show the automatic detection accuracy as baselines, including BERT, RoBERTa, ALBERT, and XLNet. As a result of 5-fold cross-validation, we achieved the highest accuracy of 0.975 with RoBERTa. The dataset and baseline source codes are available at https://github.com/yamanalab/ec-darkpattern.


title: Correcting Faulty Road Maps by Image Inpainting

abstract: As maintaining road networks is labor-intensive, many automatic road extraction approaches have been introduced to solve this real-world problem, fueled by the abundance of large-scale high-resolution satellite imagery and advances in computer vision. However, their performance is limited for fully automating the road map extraction in real-world services. Hence, many services employ the two-step human-in-the-loop system to post-process the extracted road maps: error localization and automatic mending for faulty road maps. Our paper exclusively focuses on the latter step, introducing a novel image inpainting approach for fixing road maps with complex road geometries without custom-made heuristics, yielding a method that is readily applicable to any road geometry extraction model. We demonstrate the effectiveness of our method on various real-world road geometries, such as straight and curvy roads, T-junctions, and intersections.


title: Self-Supervised Graph Structure Refinement for Graph Neural Networks

abstract: Graph structure learning (GSL), which aims to learn the adjacency matrix for graph neural networks (GNNs), has shown great potential in boosting the performance of GNNs. Most existing GSL works apply a joint learning framework where the estimated adjacency matrix and GNN parameters are optimized for downstream tasks. However, as GSL is essentially a link prediction task, whose goal may largely differ from the goal of the downstream task. The inconsistency of these two goals limits the GSL methods to learn the potential optimal graph structure. Moreover, the joint learning framework suffers from scalability issues in terms of time and space during the process of estimation and optimization of the adjacency matrix. To mitigate these issues, we propose a graph structure refinement (GSR) framework with a pretrain-finetune pipeline. Specifically, The pre-training phase aims to comprehensively estimate the underlying graph structure by a multi-view contrastive learning framework with both intra- and inter-view link prediction tasks. Then, the graph structure is refined by adding and removing edges according to the edge probabilities estimated by the pre-trained model. Finally, the fine-tuning GNN is initialized by the pre-trained model and optimized toward downstream tasks. With the refined graph structure remaining static in the fine-tuning space, GSR avoids estimating and optimizing graph structure in the fine-tuning phase which enjoys great scalability and efficiency. Moreover, the fine-tuning GNN is boosted by both migrating knowledge and refining graphs. Extensive experiments are conducted to evaluate the effectiveness (best performance on six benchmark datasets), efficiency, and scalability (13.8x faster using 32.8% GPU memory compared to the best GSL baseline on Cora) of the proposed model.


title: Low Pass Filtering and Bandwidth Extension for Robust Anti-spoofing Countermeasure Against Codec Variabilities

abstract: A reliable voice anti-spoofing countermeasure system needs to robustly protect automatic speaker verification (ASV) systems in various kinds of spoofing scenarios. However, the performance of countermeasure systems could be degraded by channel effects and codecs. In this paper, we show that using the low-frequency subbands of signals as input can mitigate the negative impact introduced by codecs on the countermeasure systems. To validate this, two types of low-pass filters with different cut-off frequencies are applied to countermeasure systems, and the equal error rate (EER) is reduced by up to 25% relatively. In addition, we propose a deep learning based bandwidth extension approach to further improve the detection accuracy. Recent studies show that the error rate of countermeasure systems increase dramatically when the silence part is removed by Voice Activity Detection (VAD), our experimental results show that the filtering and bandwidth extension approaches are also effective under the codec condition when VAD is applied.