title: The Science of Startups: The Impact of Founder Personalities on Company Success

abstract: Startup companies solve many of today's most complex and challenging scientific, technical and social problems, such as the decarbonisation of the economy, air pollution, and the development of novel life-saving vaccines. Startups are a vital source of social, scientific and economic innovation, yet the most innovative are also the least likely to survive. The probability of success of startups has been shown to relate to several firm-level factors such as industry, location and the economy of the day. Still, attention has increasingly considered internal factors relating to the firm's founding team, including their previous experiences and failures, their centrality in a global network of other founders and investors as well as the team's size. The effects of founders' personalities on the success of new ventures are mainly unknown. Here we show that founder personality traits are a significant feature of a firm's ultimate success. We draw upon detailed data about the success of a large-scale global sample of startups. We found that the Big 5 personality traits of startup founders across 30 dimensions significantly differed from that of the population at large. Key personality facets that distinguish successful entrepreneurs include a preference for variety, novelty and starting new things (openness to adventure), like being the centre of attention (lower levels of modesty) and being exuberant (higher activity levels). However, we do not find one "Founder-type" personality; instead, six different personality types appear, with startups founded by a "Hipster, Hacker and Hustler" being twice as likely to succeed. Our results also demonstrate the benefits of larger, personality-diverse teams in startups, which has the potential to be extended through further research into other team settings within business, government and research.


title: Search for the Epoch of Reionisation with HERA: Upper Limits on the Closure Phase Delay Power Spectrum

abstract: Radio interferometers aiming to measure the power spectrum of the redshifted 21 cm line during the Epoch of Reionisation (EoR) need to achieve an unprecedented dynamic range to separate the weak signal from overwhelming foreground emissions. Calibration inaccuracies can compromise the sensitivity of these measurements to the effect that a detection of the EoR is precluded. An alternative to standard analysis techniques makes use of the closure phase, which allows one to bypass antenna-based direction-independent calibration. Similarly to standard approaches, we use a delay spectrum technique to search for the EoR signal. Using 94 nights of data observed with Phase I of the Hydrogen Epoch of Reionization Array (HERA), we place approximate constraints on the 21 cm power spectrum at $z=7.7$. We find at 95% confidence that the 21 cm EoR brightness temperature is $\le$(372)$^2$ "pseudo" mK$^2$ at 1.14 "pseudo" $h$ Mpc$^{-1}$, where the "pseudo" emphasises that these limits are to be interpreted as approximations to the actual distance scales and brightness temperatures. Using a fiducial EoR model, we demonstrate the feasibility of detecting the EoR with the full array. Compared to standard methods, the closure phase processing is relatively simple, thereby providing an important independent check on results derived using visibility intensities, or related.


title: Constraint maps with free boundaries: the obstacle case

abstract: This paper revives a four-decade-old problem concerning regularity theory for (continuous) constraint maps with free boundaries. Dividing the map into two parts, the distance part and the projected image to the constraint, one can prove various properties for each component. As already pointed out in the literature, the distance part falls under the classical obstacle problem, which is well-studied by classical methods. A perplexing issue, untouched in the literature, is the properties of the projected image and its higher regularity, which we show to be at most of class $C^{2,1}$. In arbitrary dimensions, we prove that the image map is globally of class $W^{3,BMO}$, and locally of class $C^{2,1}$ around the regular part of the free boundary. The issue becomes more delicate around singular points, and we resolve it in two dimensions. In the appendix, we extend some of our results to what we call leaky maps.


title: Young Diagrams and Classical Groups

abstract: Young diagrams are ubiquitous in combinatorics and representation theory. Here we explain these diagrams, focusing on how they are used to classify representations of the symmetric groups $S_n$ and various "classical groups": famous groups of matrices such as the general linear group $\mathrm{GL}(n,\mathbb{C})$ consisting of all invertible $n \times n$ complex matrices, the special linear group $\mathrm{SL}(n,\mathbb{C})$ consisting of all $n \times n$ complex matrices with determinant 1, the group $\mathrm{U}(n)$ consisting of all unitary $n \times n$ matrices, and the special unitary group $\mathrm{SU}(n)$ consisting of all unitary $n \times n$ matrices with determinant 1. We also discuss representations of the full linear monoid consisting of all linear transformations of $\mathbb{C}^n$. These notes, based on the column This Week's Finds in Mathematical Physics, are made to accompany a series of lecture videos.


title: Filtered Iterative Denoising for Linear Inverse Problems

abstract: Iterative denoising algorithms (IDAs) have been tremendously successful in a range of linear inverse problems arising in signal and image processing. The classic instance of this is the famous Iterative Soft-Thresholding Algorithm (ISTA), based on soft-thresholding of wavelet coefficients. More modern approaches to IDAs replace soft-thresholding with a black-box denoiser, such as BM3D or a learned deep neural network denoiser. These are often referred to as ``plug-and-play" (PnP) methods because, in principle, an off-the-shelf denoiser can be used for a variety of different inverse problems. The problem with PnP methods is that they may not provide the best solutions to a specific linear inverse problem; better solutions can often be obtained by a denoiser that is customized to the problem domain. A problem-specific denoiser, however, requires expensive re-engineering or re-learning which eliminates the simplicity and ease that makes PnP methods attractive in the first place. This paper proposes a new IDA that allows one to use a general, black-box denoiser more effectively via a simple linear filtering modification to the usual gradient update steps that accounts for the specific linear inverse problem. The proposed Filtered IDA (FIDA) is mathematically derived from the classical ISTA and wavelet denoising viewpoint. We show experimentally that FIDA can produce superior results compared to existing IDA methods with BM3D.


title: Verification of Nondeterministic Quantum Programs

abstract: Nondeterministic choice is a useful program construct that provides a way to describe the behaviour of a program without specifying the details of possible implementations. It supports the stepwise refinement of programs, a method that has proven useful in software development. Nondeterminism has also been introduced in quantum programming, and the termination of nondeterministic quantum programs has been extensively analysed. In this paper, we go beyond termination analysis to investigate the verification of nondeterministic quantum programs where properties are given by sets of hermitian operators on the associated Hilbert space. Hoare-type logic systems for partial and total correctness are proposed, which turn out to be both sound and relatively complete with respect to their corresponding semantic correctness. To show the utility of these proof systems, we analyse some quantum algorithms, such as quantum error correction scheme, the Deutsch algorithm, and a nondeterministic quantum walk. Finally, a proof assistant prototype is implemented to aid in the automated reasoning of nondeterministic quantum programs.


title: Tree-Based Representation and Generation of Natural and Mathematical Language

abstract: Mathematical language in scientific communications and educational scenarios is important yet relatively understudied compared to natural languages. Recent works on mathematical language focus either on representing stand-alone mathematical expressions, especially in their natural tree format, or mathematical reasoning in pre-trained natural language models. Existing works on jointly modeling and generating natural and mathematical languages simply treat mathematical expressions as text, without accounting for the rigid structural properties of mathematical expressions. In this paper, we propose a series of modifications to existing language models to jointly represent and generate text and math: representing mathematical expressions as sequences of node tokens in their operator tree format, using math symbol and tree position embeddings to preserve the semantic and structural properties of mathematical expressions, and using a constrained decoding method to generate mathematically valid expressions. We ground our modifications in GPT-2, resulting in a model MathGPT, and demonstrate that it outperforms baselines on mathematical expression generation tasks.


title: Multi-Task Differential Privacy Under Distribution Skew

abstract: We study the problem of multi-task learning under user-level differential privacy, in which $n$ users contribute data to $m$ tasks, each involving a subset of users. One important aspect of the problem, that can significantly impact quality, is the distribution skew among tasks. Certain tasks may have much fewer data samples than others, making them more susceptible to the noise added for privacy. It is natural to ask whether algorithms can adapt to this skew to improve the overall utility. We give a systematic analysis of the problem, by studying how to optimally allocate a user's privacy budget among tasks. We propose a generic algorithm, based on an adaptive reweighting of the empirical loss, and show that when there is task distribution skew, this gives a quantifiable improvement of excess empirical risk. Experimental studies on recommendation problems that exhibit a long tail of small tasks, demonstrate that our methods significantly improve utility, achieving the state of the art on two standard benchmarks.


title: Discovery of Critical Thresholds in Mixed Exposures and Estimation of Policy Intervention Effects using Targeted Learning

abstract: Traditional regulations of chemical exposure tend to focus on single exposures, overlooking the potential amplified toxicity due to multiple concurrent exposures. We are interested in understanding the average outcome if exposures were limited to fall under a multivariate threshold. Because threshold levels are often unknown \textit{a priori}, we provide an algorithm that finds exposure threshold levels where the expected outcome is maximized or minimized. Because both identifying thresholds and estimating policy effects on the same data would lead to overfitting bias, we also provide a data-adaptive estimation framework, which allows for both threshold discovery and policy estimation. Simulation studies show asymptotic convergence to the optimal exposure region and to the true effect of an intervention. We demonstrate how our method identifies true interactions in a public synthetic mixture data set. Finally, we applied our method to NHANES data to discover metal exposures that have the most harmful effects on telomere length. We provide an implementation in the \texttt{CVtreeMLE} R package.


title: A note on Polya groups

abstract: Let $K/\mathbf{Q}$ be a finite Galois extension. The P\'olya group of $K$ is the subgroup of the class group $Cl(K)$, generated by the classes of ambiguous ideals of $K$. In this note, among other results, we prove that every finite abelian group is isomorphic to the P\'olya group of a number field.


title: Searching for phase transitions in neutron stars with modified Gaussian processes

abstract: Gaussian processes provide a promising framework by which to extrapolate the equation of state (EoS) of cold, catalyzed matter beyond $1-2$ times nuclear saturation density. Here we discuss how to extend Gaussian processes to include nontrivial features in the speed of sound, such as bumps, kinks, and plateaus, which are predicted by nuclear models with exotic degrees of freedom. Using a fully Bayesian analysis incorporating measurements from X-ray sources, gravitational wave observations, and perturbative QCD results, we show that these features are compatible with current constraints and report on how the features affect the EoS posteriors.


title: PRedItOR: Text Guided Image Editing with Diffusion Prior

abstract: Diffusion models have shown remarkable capabilities in generating high quality and creative images conditioned on text. An interesting application of such models is structure preserving text guided image editing. Existing approaches rely on text conditioned diffusion models such as Stable Diffusion or Imagen and require compute intensive optimization of text embeddings or fine-tuning the model weights for text guided image editing. We explore text guided image editing with a Hybrid Diffusion Model (HDM) architecture similar to DALLE-2. Our architecture consists of a diffusion prior model that generates CLIP image embedding conditioned on a text prompt and a custom Latent Diffusion Model trained to generate images conditioned on CLIP image embedding. We discover that the diffusion prior model can be used to perform text guided conceptual edits on the CLIP image embedding space without any finetuning or optimization. We combine this with structure preserving edits on the image decoder using existing approaches such as reverse DDIM to perform text guided image editing. Our approach, PRedItOR does not require additional inputs, fine-tuning, optimization or objectives and shows on par or better results than baselines qualitatively and quantitatively. We provide further analysis and understanding of the diffusion prior model and believe this opens up new possibilities in diffusion models research.


title: A Meta-Learning Approach to Population-Based Modelling of Structures

abstract: A major problem of machine-learning approaches in structural dynamics is the frequent lack of structural data. Inspired by the recently-emerging field of population-based structural health monitoring (PBSHM), and the use of transfer learning in this novel field, the current work attempts to create models that are able to transfer knowledge within populations of structures. The approach followed here is meta-learning, which is developed with a view to creating neural network models which are able to exploit knowledge from a population of various tasks to perform well in newly-presented tasks, with minimal training and a small number of data samples from the new task. Essentially, the method attempts to perform transfer learning in an automatic manner within the population of tasks. For the purposes of population-based structural modelling, the different tasks refer to different structures. The method is applied here to a population of simulated structures with a view to predicting their responses as a function of some environmental parameters. The meta-learning approach, which is used herein is the model-agnostic meta-learning (MAML) approach; it is compared to a traditional data-driven modelling approach, that of Gaussian processes, which is a quite effective alternative when few data samples are available for a problem. It is observed that the models trained using meta-learning approaches, are able to outperform conventional machine learning methods regarding inference about structures of the population, for which only a small number of samples are available. Moreover, the models prove to learn part of the physics of the problem, making them more robust than plain machine-learning algorithms. Another advantage of the methods is that the structures do not need to be parametrised in order for the knowledge transfer to be performed.


title: Quantum simulation of battery materials using ionic pseudopotentials

abstract: Ionic pseudopotentials are widely used in classical simulations of materials to model the effective potential due to the nucleus and the core electrons. Modeling fewer electrons explicitly results in a reduction in the number of plane waves needed to accurately represent the states of a system. In this work, we introduce a quantum algorithm that uses pseudopotentials to reduce the cost of simulating periodic materials on a quantum computer. We use a qubitization-based quantum phase estimation algorithm that employs a first-quantization representation of the Hamiltonian in a plane-wave basis. We address the challenge of incorporating the complexity of pseudopotentials into quantum simulations by developing highly-optimized compilation strategies for the qubitization of the Hamiltonian. This includes a linear combination of unitaries decomposition that leverages the form of separable pseudopotentials. Our strategies make use of quantum read-only memory subroutines as a more efficient alternative to quantum arithmetic. We estimate the computational cost of applying our algorithm to simulating lithium-excess cathode materials for batteries, where more accurate simulations are needed to inform strategies for gaining reversible access to the excess capacity they offer. We estimate the number of qubits and Toffoli gates required to perform sufficiently accurate simulations with our algorithm for three materials: lithium manganese oxide, lithium nickel-manganese oxide, and lithium manganese oxyfluoride. Our optimized compilation strategies result in a pseudopotential-based quantum algorithm with a total Toffoli cost four orders of magnitude lower than the previous state of the art for a fixed target accuracy.


title: Correlation-Aware Neural Networks for DDoS Attack Detection In IoT Systems

abstract: We present a comprehensive study on applying machine learning to detect distributed Denial of service (DDoS) attacks using large-scale Internet of Things (IoT) systems. While prior works and existing DDoS attacks have largely focused on individual nodes transmitting packets at a high volume, we investigate more sophisticated futuristic attacks that use large numbers of IoT devices and camouflage their attack by having each node transmit at a volume typical of benign traffic. We introduce new correlation-aware architectures that take into account the correlation of traffic across IoT nodes, and we also compare the effectiveness of centralized and distributed detection models. We extensively analyze the proposed architectures by evaluating five different neural network models trained on a dataset derived from a 4060-node real-world IoT system. We observe that long short-term memory (LSTM) and a transformer-based model, in conjunction with the architectures that use correlation information of the IoT nodes, provide higher performance (in terms of F1 score and binary accuracy) than the other models and architectures, especially when the attacker camouflages itself by following benign traffic distribution on each transmitting node. For instance, by using the LSTM model, the distributed correlation-aware architecture gives 81% F1 score for the attacker that camouflages their attack with benign traffic as compared to 35% for the architecture that does not use correlation information. We also investigate the performance of heuristics for selecting a subset of nodes to share their data for correlation-aware architectures to meet resource constraints.


title: The Flood Mitigation Problem in a Road Network

abstract: Natural disasters are highly complex and unpredictable. However, long-term planning and preparedness activities can help to mitigate the consequences and reduce the damage. For example, in cities with a high risk of flooding, appropriate roadway mitigation can help reduce the impact of floods or high waters on transportation systems. Such communities could benefit from a comprehensive assessment of mitigation on road networks and identification of the best subset of roads to mitigate. In this study, we address a pre-disaster planning problem that seeks to strengthen a road network against flooding. We develop a network design problem that maximizes the improvement in accessibility and travel times between population centers and healthcare facilities subject to a given budget. We provide techniques for reducing the problem size to help make the problem tractable. We use cities in the state of Iowa in our computational experiments.


title: Generative data-driven approaches for stochastic subgrid parameterizations in an idealized ocean model

abstract: Subgrid parameterizations of mesoscale eddies continue to be in demand for climate simulations. These subgrid parameterizations can be powerfully designed using physics and/or data-driven methods, with uncertainty quantification. For example, Guillaumin and Zanna (2021) proposed a Machine Learning (ML) model that predicts subgrid forcing and its local uncertainty. The major assumption and potential drawback of this model is the statistical independence of stochastic residuals between grid points. Here, we aim to improve the simulation of stochastic forcing with generative models of ML, such as Generative adversarial network (GAN) and Variational autoencoder (VAE). Generative models learn the distribution of subgrid forcing conditioned on the resolved flow directly from data and they can produce new samples from this distribution. Generative models can potentially capture not only the spatial correlation but any statistically significant property of subgrid forcing. We test the proposed stochastic parameterizations offline and online in an idealized ocean model. We show that generative models are able to predict subgrid forcing and its uncertainty with spatially correlated stochastic forcing. Online simulations for a range of resolutions demonstrated that generative models are superior to the baseline ML model at the coarsest resolution.


title: Trust-Region-Free Policy Optimization for Stochastic Policies

abstract: Trust Region Policy Optimization (TRPO) is an iterative method that simultaneously maximizes a surrogate objective and enforces a trust region constraint over consecutive policies in each iteration. The combination of the surrogate objective maximization and the trust region enforcement has been shown to be crucial to guarantee a monotonic policy improvement. However, solving a trust-region-constrained optimization problem can be computationally intensive as it requires many steps of conjugate gradient and a large number of on-policy samples. In this paper, we show that the trust region constraint over policies can be safely substituted by a trust-region-free constraint without compromising the underlying monotonic improvement guarantee. The key idea is to generalize the surrogate objective used in TRPO in a way that a monotonic improvement guarantee still emerges as a result of constraining the maximum advantage-weighted ratio between policies. This new constraint outlines a conservative mechanism for iterative policy optimization and sheds light on practical ways to optimize the generalized surrogate objective. We show that the new constraint can be effectively enforced by being conservative when optimizing the generalized objective function in practice. We call the resulting algorithm Trust-REgion-Free Policy Optimization (TREFree) as it is free of any explicit trust region constraints. Empirical results show that TREFree outperforms TRPO and Proximal Policy Optimization (PPO) in terms of policy performance and sample efficiency.


title: On the Detection and Quantification of Nonlinearity via Statistics of the Gradients of a Black-Box Model

abstract: Detection and identification of nonlinearity is a task of high importance for structural dynamics. Detecting nonlinearity in a structure, which has been designed to operate in its linear region, might indicate the existence of damage. Therefore, it is important, even for safety reasons, to detect when a structure exhibits nonlinear behaviour. In the current work, a method to detect nonlinearity is proposed, based on the distribution of the gradients of a data-driven model, which is fitted on data acquired from the structure of interest. The data-driven model herein is a neural network. The selection of such a type of model was done in order to not allow the user to decide how linear or nonlinear the model shall be, but to let the training algorithm of the neural network shape the level of nonlinearity according to the training data. The neural network is trained to predict the accelerations of the structure for a time-instant using as inputs accelerations of previous time-instants, i.e. one-step-ahead predictions. Afterwards, the gradients of the output of the neural network with respect to its inputs are calculated. Given that the structure is linear, the distribution of the aforementioned gradients should be quite peaked, while in the case of a structure with nonlinearities, the distribution of the gradients shall be more spread and, potentially, multimodal. To test the above assumption, data from an experimental structure are considered. The structure is tested under different scenarios, some of which are linear and some nonlinear. The statistics of the distributions of the gradients for the different scenarios can be used to identify cases where nonlinearity is present. Moreover, via the proposed method one is able to quantify the nonlinearity by observing higher values of standard deviation of the distribution of the gradients for "more nonlinear" scenarios.


title: The Halo Conjecture for GL2

abstract: We prove the Halo conjecture on the geometry of the eigencurve over the boundary of the weight space, predicted by Coleman-Mazur and Buzzard-Kilford.


title: An experimental high-throughput to high-fidelity study towards discovering Al-Cr containing corrosion-resistant compositionally complex alloys

abstract: Compositionally complex alloys hold the promise of simultaneously attaining superior combinations of properties, such as corrosion resistance, light-weighting, and strength. Achieving this goal is a challenge due in part to a large number of possible compositions and structures in the vast alloy design space. High-throughput methods offer a path forward, but a strong connection between the synthesis of an alloy of a given composition and structure with its properties has not been fully realized to date. Here, we present the rapid identification of corrosion-resistant alloys based on combinations of Al and Cr in a base Al-Co-Cr-Fe-Ni alloy. Previously unstudied alloy stoichiometries were identified using a combination of high-throughput experimental screening coupled with key metallurgical and electrochemical corrosion tests, identifying alloys with excellent passivation behavior. The alloy native oxide performance and its self-healing attributes were probed using rapid tests in deaerated 0.1 mol/L H2SO4. Importantly, a correlation was found between the electrochemical impedance modulus of the exposure-modified air-formed film and self-healing rate of the CCAs. Multi-element extended x-ray absorption fine structure analyses connected more ordered type chemical short-range order in the Ni-Al 1st nearest-neighbor shell to poorer corrosion resistance. This report underscores the utility of high throughput exploration of compositionally complex alloys for the identification and rapid screening of a vast stoichiometric space.


title: From Graph Generation to Graph Classification

abstract: This note describes a new approach to classifying graphs that leverages graph generative models (GGM). Assuming a GGM that defines a joint probability distribution over graphs and their class labels, I derive classification formulas for the probability of a class label given a graph. A new conditional ELBO can be used to train a generative graph auto-encoder model for discrimination. While leveraging generative models for classification has been well explored for non-relational i.i.d. data, to our knowledge it is a novel approach to graph classification.


title: Efficient Computational method using random matrices describing critical thermodynamics

abstract: Our research highlights the effectiveness of utilizing matrices akin to Wishart matrices, derived from magnetization time series data under specific dynamics, to elucidate phase transitions and critical phenomena in the Q-state Potts model. By employing appropriate statistical methods, we not only discern second-order transitions but also differentiate weaker first-order transitions through careful analysis of the density of eigenvalues and their fluctuations. Furthermore, we investigate the method's sensitivity to stronger first-order transition points. Importantly, we establish a robust correlation between the system's actual thermodynamics and the spectral thermodynamics encapsulated within the eigenvalues. Our findings are further substantiated by correlation histograms of the time series data, revealing insightful patterns. Expanding upon our core findings, we present a didactic analysis that draws parallels between the spectral properties of criticality in a spin system and matrices intentionally imbued with correlations (a toy model). Within this framework, we observe a universal behavior characterized by the distribution of eigenvalues into two distinct groups, separated by a gap dependent on the level of correlation, influenced by temperature-induced changes in the spin system.


title: Gorensteinness for normal tangent cones of elliptic ideals

abstract: Let $A$ be a two-dimensional excellent normal Gorenstein local domain. In this paper, we characterize elliptic ideals $I \subset A$ for its normal tangent cone $\overline{G}(I)$ to be Gorenstein. Moreover, we classify all those ideals in a Gorenstein elliptic singularity in the characteristic zero case.


title: Vector-based Efficient Data Hiding in Encrypted Images via Multi-MSB Replacement

abstract: As an essential technique for data privacy protection, reversible data hiding in encrypted images (RDHEI) methods have drawn intensive research interest in recent years. In response to the increasing demand for protecting data privacy, novel methods that perform RDHEI are continually being developed. We propose two effective multi-MSB (most significant bit) replacement-based approaches that yield comparably high data embedding capacity, improve overall processing speed, and enhance reconstructed images' quality. Our first method, Efficient Multi-MSB Replacement-RDHEI (EMR-RDHEI), obtains higher data embedding rates (DERs, also known as payloads) and better visual quality in reconstructed images when compared with many other state-of-the-art methods. Our second method, Lossless Multi-MSB Replacement-RDHEI (LMR-RDHEI), can losslessly recover original images after an information embedding process is performed. To verify the accuracy of our methods, we compared them with other recent RDHEI techniques and performed extensive experiments using the widely accepted BOWS-2 dataset. Our experimental results showed that the DER of our EMR-RDHEI method ranged from 1.2087 bit per pixel (bpp) to 6.2682 bpp with an average of 3.2457 bpp. For the LMR-RDHEI method, the average DER was 2.5325 bpp, with a range between 0.2129 bpp and 6.0168 bpp. Our results demonstrate that these methods outperform many other state-of-the-art RDHEI algorithms. Additionally, the multi-MSB replacement-based approach provides a clean design and efficient vectorized implementation.


title: A blue sky bifurcation in the dynamics of political candidates

abstract: Political candidates often shift their positions opportunistically in hopes of capturing more votes. When there are only two candidates, the best strategy for each of them is often to move towards the other. This eventually results in two centrists with coalescing views. However, the strategy of moving towards the other candidate ceases to be optimal when enough voters abstain instead of voting for a centrist who does not represent their views. These observations, formalized in various ways, have been made many times. Our own formalization is based on differential equations. The surprise and main result derived from these equations is that the final candidate positions can jump discontinuously as the voters' loyalty towards their candidate wanes. The underlying mathematical mechanism is a blue sky bifurcation.


title: \`A-la-carte Prompt Tuning (APT): Combining Distinct Data Via Composable Prompting

abstract: We introduce \`A-la-carte Prompt Tuning (APT), a transformer-based scheme to tune prompts on distinct data so that they can be arbitrarily composed at inference time. The individual prompts can be trained in isolation, possibly on different devices, at different times, and on different distributions or domains. Furthermore each prompt only contains information about the subset of data it was exposed to during training. During inference, models can be assembled based on arbitrary selections of data sources, which we call "\`a-la-carte learning". \`A-la-carte learning enables constructing bespoke models specific to each user's individual access rights and preferences. We can add or remove information from the model by simply adding or removing the corresponding prompts without retraining from scratch. We demonstrate that \`a-la-carte built models achieve accuracy within $5\%$ of models trained on the union of the respective sources, with comparable cost in terms of training and inference time. For the continual learning benchmarks Split CIFAR-100 and CORe50, we achieve state-of-the-art performance.


title: Local vs. translationally-invariant slowest operators in quantum Ising spin chains

abstract: In this paper we study one-dimensional quantum Ising spin chains in external magnetic field close to an integrable point. We concentrate on the dynamics of the slowest operator, that plays a key role at the final period of thermalization. We introduce two independent definitions of the slowest operator: local and translationally-invariant ones. We construct both operators numerically using tensor networks and extensively compare their physical properties. We find that the local operator has a significant overlap with energy flux, it does not correspond to an integral of motion, and, as one goes away from the integrable point, its revivals get suppressed and the rate of delocalization changes from extremely slow to slower than diffusion. The translationally-invariant operator corresponds to an integral of motion; as the system becomes less integrable, at some point this operator changes its nature: from no overlap with any magnetization and fast rate of delocalization, to non-zero overlap with magnetizations $\sigma_{x}$ and $\sigma_{z}$ and slow rate of delocalization.


title: A Comparison of Reinforcement Learning and Deep Trajectory Based Stochastic Control Agents for Stepwise Mean-Variance Hedging

abstract: We consider two data-driven approaches to hedging, Reinforcement Learning and Deep Trajectory-based Stochastic Optimal Control, under a stepwise mean-variance objective. We compare their performance for a European call option in the presence of transaction costs under discrete trading schedules. We do this for a setting where stock prices follow Black-Scholes-Merton dynamics and the "book-keeping" price for the option is given by the Black-Scholes-Merton model with the same parameters. This simulated data setting provides a "sanitized" lab environment with simple enough features where we can conduct a detailed study of strengths, features, issues, and limitations of these two approaches. However, the formulation is model free and could allow any other setting with available book-keeping prices. We consider this study as a first step to develop, test, and validate autonomous hedging agents, and we provide blueprints for such efforts that address various concerns and requirements.


title: Analysis of linearized Weyl gravity via the Hamilton-Jacobi method

abstract: The Hamilton-Jacobi formalism is used to analyze the Weyl theory in the weak-field limit. The complete set of involutive Hamiltonians is obtained, which are classified into involutive and non-involutive. The counting of degrees of freedom is performed. Additionally, the generalized brackets and gauge symmetries are reported.


title: cGAN-Based High Dimensional IMU Sensor Data Generation for Enhanced Human Activity Recognition in Therapeutic Activities

abstract: Human activity recognition is a core technology for applications such as rehabilitation, health monitoring, and human-computer interactions. Wearable devices, especially IMU sensors, provide rich features of human movements at a reasonable cost, which can be leveraged in activity recognition. Developing a robust classifier for activity recognition has always been of interest to researchers. One major problem is that there is usually a deficit of training data, which makes developing deep classifiers difficult and sometimes impossible. In this work, a novel GAN network called TheraGAN was developed to generate IMU signals associated with rehabilitation activities. The generated signal comprises data from a 6-channel IMU, i.e., angular velocities and linear accelerations. Also, introducing simple activities simplified the generation process for activities of varying lengths. To evaluate the generated signals, several qualitative and quantitative studies were conducted, including perceptual similarity analysis, comparing manually extracted features to those from real data, visual inspection, and an investigation into how the generated data affects the performance of three deep classifiers trained on the generated and real data. The results showed that the generated signals closely mimicked the real signals, and adding generated data resulted in a significant improvement in the performance of all tested networks. Among the tested networks, the LSTM classifier demonstrated the most significant improvement, achieving a 13.27% boost, effectively addressing the challenge of data scarcity. This shows the validity of the generated data as well as TheraGAN as a tool to build more robust classifiers in case of imbalanced and insufficient data problems.


title: Hamiltonian analysis for new massive gravity

abstract: A detailed canonical analysis for three-dimensional massive gravity is performed. The construction of the fundamental Dirac brackets, the complete structure of the constraints and the counting of the physical degrees of freedom are reported. In addition, it is shown that the extended Hamiltonian is healed from Orstrogradki's instabilities.


title: How Effective is Multiple-Vantage-Point Domain Control Validation?

abstract: Multiple-vantage-point domain control validation (multiVA) is an emerging defense for mitigating BGP hijacking attacks against certificate authorities. While the adoption of multiVA is on the rise, little work has quantified its effectiveness against BGP hijacks in the wild. We bridge the gap by presenting the first analysis framework that measures the security of a multiVA deployment under real-world network configurations (e.g., DNS and RPKI). Our framework accurately models the attack surface of multiVA by 1) considering the attacks on DNS nameservers involved in domain validation, 2) considering deployed practical security techniques such as RPKI, 3) performing fine-grained internet-scale analysis to compute multiVA resilience (i.e., how difficult it is to launch a BGP hijack against a domain and get a bogus certificate under multiVA). We use our framework to perform a rigorous security analysis of the multiVA deployment of Let's Encrypt, using a dataset that consists of about 1 million certificates and 31 billion DNS queries collected over four months. Our analysis shows while DNS does enlarge the attack surface of multiVA, the of Let's Encrypt's multiVA deployment still offers an 88% median resilience against BGP hijacks, a notable improvement over 76% offered by single-vantage-point validation. RPKI, even in its current state of partial deployment, effectively mitigates BGP attacks and improves the security of the deployment by 15% as compared to the case without considering RPKI. Exploring 11,000 different multiVA configurations, we find that Let's Encrypt's deployment can be further enhanced to achieve a resilience of over 99% by using a full quorum policy with only two additional vantage points in different public clouds.


title: Learning Density-Based Correlated Equilibria for Markov Games

abstract: Correlated Equilibrium (CE) is a well-established solution concept that captures coordination among agents and enjoys good algorithmic properties. In real-world multi-agent systems, in addition to being in an equilibrium, agents' policies are often expected to meet requirements with respect to safety, and fairness. Such additional requirements can often be expressed in terms of the state density which measures the state-visitation frequencies during the course of a game. However, existing CE notions or CE-finding approaches cannot explicitly specify a CE with particular properties concerning state density; they do so implicitly by either modifying reward functions or using value functions as the selection criteria. The resulting CE may thus not fully fulfil the state-density requirements. In this paper, we propose Density-Based Correlated Equilibria (DBCE), a new notion of CE that explicitly takes state density as selection criterion. Concretely, we instantiate DBCE by specifying different state-density requirements motivated by real-world applications. To compute DBCE, we put forward the Density Based Correlated Policy Iteration algorithm for the underlying control problem. We perform experiments on various games where results demonstrate the advantage of our CE-finding approach over existing methods in scenarios with state-density concerns.


title: Deep Learning Enhanced Realized GARCH

abstract: We propose a new approach to volatility modeling by combining deep learning (LSTM) and realized volatility measures. This LSTM-enhanced realized GARCH framework incorporates and distills modeling advances from financial econometrics, high frequency trading data and deep learning. Bayesian inference via the Sequential Monte Carlo method is employed for statistical inference and forecasting. The new framework can jointly model the returns and realized volatility measures, has an excellent in-sample fit and superior predictive performance compared to several benchmark models, while being able to adapt well to the stylized facts in volatility. The performance of the new framework is tested using a wide range of metrics, from marginal likelihood, volatility forecasting, to tail risk forecasting and option pricing. We report on a comprehensive empirical study using 31 widely traded stock indices over a time period that includes COVID-19 pandemic.


title: Sign changes of the error term in the Piltz divisor problem

abstract: We study the function $\Delta_k(x):=\sum_{n\leq x} d_k(n) - \mbox{Res}_{s=1} ( \zeta^k(s) x^s/s )$, where $k\geq 3$ is an integer, $d_k(n)$ is the $k$-fold divisor function, and $\zeta(s)$ is the Riemann zeta-function. For a large parameter $X$, we show that if the Lindel\"{o}f hypothesis is true, then there exist at least $X^{\frac{1}{k(k-1)}-\varepsilon}$ disjoint subintervals of $[X,2X]$, each of length $X^{1-\frac{1}{k}-\varepsilon}$, such that $|\Delta_k(x)|\gg x^{\frac{1}{2}-\frac{1}{2k}}$ for all $x$ in the subinterval. If the Riemann hypothesis is true, then we can improve the length of the subintervals to $\gg X^{1-\frac{1}{k}} (\log X)^{-k^2-2}$. These results may be viewed as higher-degree analogues of theorems of Heath-Brown and Tsang, who studied the case $k=2$, and Cao, Tanigawa, and Zhai, who studied the case $k=3$. The first main ingredient of our proofs is a bound for the second moment of $\Delta_k(x+h)-\Delta_k(x)$. We prove this bound using a method of Selberg and a general lemma due to Saffari and Vaughan. The second main ingredient is a bound for the fourth moment of $\Delta_k(x)$, which we obtain by combining a method of Tsang with a technique of Lester.


title: Nanoscale Imaging of Super-High-Frequency Microelectromechanical Resonators with Femtometer Sensitivity

abstract: Implementing microelectromechanical system (MEMS) resonators calls for detailed microscopic understanding of the devices, such as energy dissipation channels, spurious modes, and imperfections from microfabrication. Here, we report the nanoscale imaging of a freestanding super-high-frequency (3 ~ 30 GHz) lateral overtone bulk acoustic resonator with unprecedented spatial resolution and displacement sensitivity. Using transmission-mode microwave impedance microscopy, we have visualized mode profiles of individual overtones and analyzed higher-order transverse spurious modes and anchor loss. The integrated TMIM signals are in good agreement with the stored mechanical energy in the resonator. Quantitative analysis with finite-element modeling shows that the noise floor is equivalent to an in-plane displacement of 10 fm/sqrt(Hz) at room temperatures, which can be further improved under cryogenic environments. Our work contributes to the design and characterization of MEMS resonators with better performance for telecommunication, sensing, and quantum information science applications.


title: Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training

abstract: Recent years have seen an increase in the development of large deep learning (DL) models, which makes training efficiency crucial. Common practice is struggling with the trade-off between usability and performance. On one hand, DL frameworks such as PyTorch use dynamic graphs to facilitate model developers at a price of sub-optimal model training performance. On the other hand, practitioners propose various approaches to improving the training efficiency by sacrificing some of the flexibility, ranging from making the graph static for more thorough optimization (e.g., XLA) to customizing optimization towards large-scale distributed training (e.g., DeepSpeed and Megatron-LM). In this paper, we aim to address the tension between usability and training efficiency through separation of concerns. Inspired by DL compilers that decouple the platform-specific optimizations of a tensor-level operator from its arithmetic definition, this paper proposes a schedule language, Slapo, to decouple model execution from definition. Specifically, Slapo works on a PyTorch model and uses a set of schedule primitives to convert the model for common model training optimizations such as high-performance kernels, effective 3D parallelism, and efficient activation checkpointing. Compared to existing optimization solutions, Slapo progressively optimizes the model "as-needed" through high-level primitives, and thus preserving programmability and debuggability for users to a large extent. Our evaluation results show that by scheduling the existing hand-crafted optimizations in a systematic way using Slapo, we are able to improve training throughput by up to 2.92x on a single machine with 8 NVIDIA V100 GPUs, and by up to 1.41x on multiple machines with up to 64 GPUs, when compared to the out-of-the-box performance of DeepSpeed and Megatron-LM.


title: Un sistema automatizado para el adiestramiento y evaluacion de estudiantes de fisica ante examenes cerrados

abstract: In this work, I present an automatic system for the evaluation of closed-type exercises in physics at the high school level or in the first year of a degree where physics is a mandatory course. It is expected that this will allow students or teachers with access to a computer or mobile device to get into a repository of exercises for different areas of physics and practice them using true or false or multiple choice options. This system is expected to solve the problem that many students do not have enough skills to face this type of evaluation, since they have not had the opportunity to work with closed-type exams that are graded by computers and are used by educational institutions such as evaluation tools. This material can also benefit teachers by providing them with an alternative form of evaluation to the traditional form. To use this system, computer programming skills are not required, since it consists of a program where the answers are selected and the program provides a numerical score, a brief interpretation, and the solutions to every exercise, which will allow students to compare their answers with the solutions.


title: With Shared Microexponents, A Little Shifting Goes a Long Way

abstract: This paper introduces Block Data Representations (BDR), a framework for exploring and evaluating a wide spectrum of narrow-precision formats for deep learning. It enables comparison of popular quantization standards, and through BDR, new formats based on shared microexponents (MX) are identified, which outperform other state-of-the-art quantization approaches, including narrow-precision floating-point and block floating-point. MX utilizes multiple levels of quantization scaling with ultra-fine scaling factors based on shared microexponents in the hardware. The effectiveness of MX is demonstrated on real-world models including large-scale generative pretraining and inferencing, and production-scale recommendation systems.


title: The variability and radial velocity of planetary nebulae central stars

abstract: The extremely accurate estimates of stellar variability and radial velocity in the Gaia Data Release 3 (Gaia DR3) have enabled us to examine the close binarity and radial velocity (RV) of central stars (CSs) of planetary nebulae (PNe). This study is twofold: (1) searching for new close binary CSs candidates to better understand how binarity affects the formation and evolution of PNe; and (2) extending the sample size of known RV of PNe in order to understand their kinematics and the dynamics of the Milky Way. As a target sample, we used all true, possible, and likely PNe available in the literature. Then, we looked for their matched Gaia DR3 sources that provide measurements of variability and RV. As a result, we detected the first large collection of trustworthy photometric variability of 26 symbiotic stars (SySts) and 82 CSs. In this CS group, there are 24 sources already classified as true close binary CSs in the literature. Hence, we discovered 58 new close binary CS candidates. This close binary (CB) sample represents more than half of what is currently available in the literature. In addition, we identified the radial velocities for 51 PNe. To our knowledge, 24 of these were measured for the first time. The RV measurements predicted by Gaia, based on the Doppler shift of the CS absorption lines, and those derived from nebular emission lines, show satisfactory agreement except for a few extremely high-velocity PNe.


title: Scrambling and Recovery of Quantum Information in Inhomogeneous Quenches in Two-dimensional Conformal Field Theories

abstract: We study various quantum quench processes induced by the M\"obius/sine-square deformation of the Hamiltonian in two-dimensional conformal field theories starting from the thermofield double state in the two copies of the Hilbert space. These quantum quenches, some of which are directly related to the operator entanglement of the time-evolution operators, allow us to study scrambling and recovery of quantum information. In particular, under the SSD time-evolution, we show from the time-dependence of mutual information that the Bell pairs, initially shared by the subsystems of the two Hilbert spaces, may revive even after the mutual information for small subsystems is completely destroyed by quantum information scrambling dynamics. This mutual information is robust against the strong scrambling dynamics. As a consequence, the steady state has a non-local correlation shared not by any of two parties but by three parties. In the holographic dual description, a wormhole connecting the two Hilbert spaces may non-linearly grow with time during the quantum quenches. We also propose effective pictures that describe the dynamics of mutual information during the time-evolution by inhomogeneous Hamiltonians.


title: Achieving Covert Communication in Large-Scale SWIPT-Enabled D2D Networks

abstract: We aim to secure a large-scale device-to-device (D2D) network against adversaries. The D2D network underlays a downlink cellular network to reuse the cellular spectrum and is enabled for simultaneous wireless information and power transfer (SWIPT). In the D2D network, the transmitters communicate with the receivers, and the receivers extract information and energy from their received radio-frequency (RF) signals. In the meantime, the adversaries aim to detect the D2D transmission. The D2D network applies power control and leverages the cellular signal to achieve covert communication (i.e., hide the presence of transmissions) so as to defend against the adversaries. We model the interaction between the D2D network and adversaries by using a two-stage Stackelberg game. Therein, the adversaries are the followers minimizing their detection errors at the lower stage and the D2D network is the leader maximizing its network utility constrained by the communication covertness and power outage at the upper stage. Both power splitting (PS)-based and time switch (TS)-based SWIPT schemes are explored. We characterize the spatial configuration of the large-scale D2D network, adversaries, and cellular network by stochastic geometry. We analyze the adversary's detection error minimization problem and adopt the Rosenbrock method to solve it, where the obtained solution is the best response from the lower stage. Taking into account the best response from the lower stage, we develop a bi-level algorithm to solve the D2D network's constrained network utility maximization problem and obtain the Stackelberg equilibrium. We present numerical results to reveal interesting insights.


title: Vision-Based Terrain Relative Navigation on High-Altitude Balloon and Sub-Orbital Rocket

abstract: We present an experimental analysis on the use of a camera-based approach for high-altitude navigation by associating mapped landmarks from a satellite image database to camera images, and by leveraging inertial sensors between camera frames. We evaluate performance of both a sideways-tilted and downward-facing camera on data collected from a World View Enterprises high-altitude balloon with data beginning at an altitude of 33 km and descending to near ground level (4.5 km) with 1.5 hours of flight time. We demonstrate less than 290 meters of average position error over a trajectory of more than 150 kilometers. In addition to showing performance across a range of altitudes, we also demonstrate the robustness of the Terrain Relative Navigation (TRN) method to rapid rotations of the balloon, in some cases exceeding 20 degrees per second, and to camera obstructions caused by both cloud coverage and cords swaying underneath the balloon. Additionally, we evaluate performance on data collected by two cameras inside the capsule of Blue Origin's New Shepard rocket on payload flight NS-23, traveling at speeds up to 880 km/hr, and demonstrate less than 55 meters of average position error.


title: Equilibrium of Data Markets with Externality

abstract: We model real-world data markets, where sellers post fixed prices and buyers are free to purchase from any set of sellers, as a simultaneous game. A key component here is the negative externality buyers induce on one another due to data purchases. Starting with a simple setting where buyers know their valuations a priori, we characterize both the existence and welfare properties of the pure Nash equilibrium in the presence of such externality. While the outcomes are bleak without any intervention, mirroring the limitations of current data markets, we prove that for a standard class of externality functions, platforms intervening through a transaction cost can lead to a pure equilibrium with strong welfare guarantees. We next consider a more realistic setting where buyers learn their valuations over time through market interactions. Our intervention is feasible here as well, and we consider learning algorithms to achieve low regret concerning both individual and cumulative utility metrics. Lastly, we analyze the promises of this intervention under a much richer externality model.


title: Revisiting boundary layer flows of viscoelastic fluids

abstract: In this article we reconsider high Reynolds number boundary layer flows of fluids with viscoelastic properties. We show that a number of previous studies that have attempted to address this problem are, in fact, incomplete. We correctly reformulate the problem and solve the governing equations using a Chebyshev collocation scheme. By analysing the decay of the solutions to the far-field we determine the correct stress boundary conditions required to solve problems of this form. Our results show that both the fluid velocity within the boundary layer and the stress at the solid boundary increase due to the effect of viscoelasticity. As a consequence of this, we predict a thinning of the boundary layer as the value of the dimensionless viscoelastic flow parameter is increased. These results contradict a number of prominent studies in the literature but are supported by results owing from an asymptotic analysis based on the assumption of the smallness of the non-dimensional viscoelastic flow parameter.


title: Entropy conserving/stable schemes for a vector-kinetic model of hyperbolic systems

abstract: The moment of entropy equation for vector-BGK model results in the entropy equation for macroscopic model. However, this is usually not the case in numerical methods because the current literature consists only of entropy conserving/stable schemes for macroscopic model (to the best of our knowledge). In this paper, we attempt to fill this gap by developing an entropy conserving scheme for vector-kinetic model, and we show that the moment of this results in an entropy conserving scheme for macroscopic model. With the numerical viscosity of entropy conserving scheme as reference, the entropy stable scheme for vector-kinetic model is developed in the spirit of [33]. We show that the moment of this scheme results in an entropy stable scheme for macroscopic model. The schemes are validated on several benchmark test problems for scalar and shallow water equations, and conservation/stability of both kinetic and macroscopic entropies are presented.


title: Individual Fairness under Uncertainty

abstract: Algorithmic fairness, the research field of making machine learning (ML) algorithms fair, is an established area in ML. As ML technologies expand their application domains, including ones with high societal impact, it becomes essential to take fairness into consideration during the building of ML systems. Yet, despite its wide range of socially sensitive applications, most work treats the issue of algorithmic bias as an intrinsic property of supervised learning, i.e., the class label is given as a precondition. Unlike prior studies in fairness, we propose an individual fairness measure and a corresponding algorithm that deal with the challenges of uncertainty arising from censorship in class labels, while enforcing similar individuals to be treated similarly from a ranking perspective, free of the Lipschitz condition in the conventional individual fairness definition. We argue that this perspective represents a more realistic model of fairness research for real-world application deployment and show how learning with such a relaxed precondition draws new insights that better explains algorithmic fairness. We conducted experiments on four real-world datasets to evaluate our proposed method compared to other fairness models, demonstrating its superiority in minimizing discrimination while maintaining predictive performance with uncertainty present.


title: Unsupervised Domain Adaptation for MRI Volume Segmentation and Classification Using Image-to-Image Translation

abstract: Unsupervised domain adaptation is a type of domain adaptation and exploits labeled data from the source domain and unlabeled data from the target one. In the Cross-Modality Domain Adaptation for Medical Image Segmenta-tion challenge (crossMoDA2022), contrast enhanced T1 MRI volumes for brain are provided as the source domain data, and high-resolution T2 MRI volumes are provided as the target domain data. The crossMoDA2022 challenge contains two tasks, segmentation of vestibular schwannoma (VS) and cochlea, and clas-sification of VS with Koos grade. In this report, we presented our solution for the crossMoDA2022 challenge. We employ an image-to-image translation method for unsupervised domain adaptation and residual U-Net the segmenta-tion task. We use SVM for the classification task. The experimental results show that the mean DSC and ASSD are 0.614 and 2.936 for the segmentation task and MA-MAE is 0.84 for the classification task.


title: Preventing Discriminatory Decision-making in Evolving Data Streams

abstract: Bias in machine learning has rightly received significant attention over the last decade. However, most fair machine learning (fair-ML) work to address bias in decision-making systems has focused solely on the offline setting. Despite the wide prevalence of online systems in the real world, work on identifying and correcting bias in the online setting is severely lacking. The unique challenges of the online environment make addressing bias more difficult than in the offline setting. First, Streaming Machine Learning (SML) algorithms must deal with the constantly evolving real-time data stream. Second, they need to adapt to changing data distributions (concept drift) to make accurate predictions on new incoming data. Adding fairness constraints to this already complicated task is not straightforward. In this work, we focus on the challenges of achieving fairness in biased data streams while accounting for the presence of concept drift, accessing one sample at a time. We present Fair Sampling over Stream ($FS^2$), a novel fair rebalancing approach capable of being integrated with SML classification algorithms. Furthermore, we devise the first unified performance-fairness metric, Fairness Bonded Utility (FBU), to evaluate and compare the trade-off between performance and fairness of different bias mitigation methods efficiently. FBU simplifies the comparison of fairness-performance trade-offs of multiple techniques through one unified and intuitive evaluation, allowing model designers to easily choose a technique. Overall, extensive evaluations show our measures surpass those of other fair online techniques previously reported in the literature.


title: Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking

abstract: The increasing use of Machine Learning (ML) software can lead to unfair and unethical decisions, thus fairness bugs in software are becoming a growing concern. Addressing these fairness bugs often involves sacrificing ML performance, such as accuracy. To address this issue, we present a novel counterfactual approach that uses counterfactual thinking to tackle the root causes of bias in ML software. In addition, our approach combines models optimized for both performance and fairness, resulting in an optimal solution in both aspects. We conducted a thorough evaluation of our approach on 10 benchmark tasks using a combination of 5 performance metrics, 3 fairness metrics, and 15 measurement scenarios, all applied to 8 real-world datasets. The conducted extensive evaluations show that the proposed method significantly improves the fairness of ML software while maintaining competitive performance, outperforming state-of-the-art solutions in 84.6% of overall cases based on a recent benchmarking tool.


title: TransEdge: Supporting Efficient Read Queries Across Untrusted Edge Nodes

abstract: We propose Transactional Edge (TransEdge), a distributed transaction processing system for untrusted environments such as edge computing systems. What distinguishes TransEdge is its focus on efficient support for read-only transactions. TransEdge allows reading from different partitions consistently using one round in most cases and no more than two rounds in the worst case. TransEdge design is centered around this dependency tracking scheme including the consensus and transaction processing protocols. Our performance evaluation shows that TransEdge's snapshot read-only transactions achieve an 9-24x speedup compared to current byzantine systems.


title: All-Electrical Skyrmionic Bits in a Chiral Magnetic Tunnel Junction

abstract: Topological spin textures such as magnetic skyrmions hold considerable promise as robust, nanometre-scale, mobile bits for sustainable computing. A longstanding roadblock to unleashing their potential is the absence of a device enabling deterministic electrical readout of individual spin textures. Here we present the wafer-scale realization of a nanoscale chiral magnetic tunnel junction (MTJ) hosting a single, ambient skyrmion. Using a suite of electrical and multi-modal imaging techniques, we show that the MTJ nucleates skyrmions of fixed polarity, whose large readout signal - 20-70% relative to uniform states - corresponds directly to skyrmion size. Further, the MTJ exploits complementary mechanisms to stabilize distinctly sized skyrmions at zero field, thereby realizing three nonvolatile electrical states. Crucially, it can write and delete skyrmions using current densities 1,000 times lower than state-of-the-art. These results provide a platform to incorporate readout and manipulation of skyrmionic bits across myriad device architectures, and a springboard to harness chiral spin textures for multi-bit memory and unconventional computing.


title: Fourier Analysis Meets Runtime Analysis: Precise Runtimes on Plateaus

abstract: We propose a new method based on discrete Fourier analysis to analyze the time evolutionary algorithms spend on plateaus. This immediately gives a concise proof of the classic estimate of the expected runtime of the $(1+1)$ evolutionary algorithm on the Needle problem due to Garnier, Kallel, and Schoenauer (1999). We also use this method to analyze the runtime of the $(1+1)$ evolutionary algorithm on a new benchmark consisting of $n/\ell$ plateaus of effective size $2^\ell-1$ which have to be optimized sequentially in a LeadingOnes fashion. Using our new method, we determine the precise expected runtime both for static and fitness-dependent mutation rates. We also determine the asymptotically optimal static and fitness-dependent mutation rates. For $\ell = o(n)$, the optimal static mutation rate is approximately $1.59/n$. The optimal fitness dependent mutation rate, when the first $k$ fitness-relevant bits have been found, is asymptotically $1/(k+1)$. These results, so far only proven for the single-instance problem LeadingOnes, thus hold for a much broader class of problems. We expect similar extensions to be true for other important results on LeadingOnes. We are also optimistic that our Fourier analysis approach can be applied to other plateau problems as well.


title: Kernel-free boundary integral method for two-phase Stokes equations with discontinuous viscosity on staggered grids

abstract: A discontinuous viscosity coefficient makes the jump conditions of the velocity and normal stress coupled together, which brings great challenges to some commonly used numerical methods to obtain accurate solutions. To overcome the difficulties, a kernel free boundary integral (KFBI) method combined with a modified marker-and-cell (MAC) scheme is developed to solve the two-phase Stokes problems with discontinuous viscosity. The main idea is to reformulate the two-phase Stokes problem into a single-fluid Stokes problem by using boundary integral equations and then evaluate the boundary integrals indirectly through a Cartesian grid-based method. Since the jump conditions of the single-fluid Stokes problems can be easily decoupled, the modified MAC scheme is adopted here and the existing fast solver can be applicable for the resulting linear saddle system. The computed numerical solutions are second order accurate in discrete $\ell^2$-norm for velocity and pressure as well as the gradient of velocity, and also second order accurate in maximum norm for both velocity and its gradient, even in the case of high contrast viscosity coefficient, which is demonstrated in numerical tests.


title: Object-centric Learning with Cyclic Walks between Parts and Whole

abstract: Learning object-centric representations from complex natural environments enables both humans and machines with reasoning abilities from low-level perceptual features. To capture compositional entities of the scene, we proposed cyclic walks between perceptual features extracted from vision transformers and object entities. First, a slot-attention module interfaces with these perceptual features and produces a finite set of slot representations. These slots can bind to any object entities in the scene via inter-slot competitions for attention. Next, we establish entity-feature correspondence with cyclic walks along high transition probability based on the pairwise similarity between perceptual features (aka "parts") and slot-binded object representations (aka "whole"). The whole is greater than its parts and the parts constitute the whole. The part-whole interactions form cycle consistencies, as supervisory signals, to train the slot-attention module. Our rigorous experiments on \textit{seven} image datasets in \textit{three} \textit{unsupervised} tasks demonstrate that the networks trained with our cyclic walks can disentangle foregrounds and backgrounds, discover objects, and segment semantic objects in complex scenes. In contrast to object-centric models attached with a decoder for the pixel-level or feature-level reconstructions, our cyclic walks provide strong learning signals, avoiding computation overheads and enhancing memory efficiency. Our source code and data are available at: \href{https://github.com/ZhangLab-DeepNeuroCogLab/Parts-Whole-Object-Centric-Learning/}{link}.


title: The most probable dynamics of receptor-ligand binding on cell membrane

abstract: We devise a method for predicting certain receptor-ligand binding behaviors, based on stochastic dynamical modelling. We consider the dynamics of a receptor binding to a ligand on the cell membrane, where the receptor and ligand perform different motions and are thus modeled by stochastic differential equations with Gaussian noise or non-Gaussian noise. We use neural networks based on Onsager-Machlup function to compute the probability $P_1$ of the unbounded receptor diffusing to the cell membrane. Meanwhile, we compute the probability $P_2$ of extracellular ligand arriving at the cell membrane by solving the associated Fokker-Planck equation. Then, we could predict the most probable binding probability by combining $P_1$ and $P_2$. In this way, we conclude with some indication about where the ligand will most probably encounter the receptor, contributing to better understanding of cell's response to external stimuli and communication with other cells.


title: Momentum analysis of complex time-periodic flows

abstract: Several methods have been proposed to characterize the complex interactions in turbulent wakes, especially for flows with strong cyclic dynamics. This paper introduces the concept of Fourier-Averaged Navier-Stokes (FANS) equations as a framework to obtain direct insights into the dynamics of complex coherent wake interactions. The method simplifies the interpretations of flow physics by identifying terms contributing to momentum transport at different timescales. The method also allows for direct interpretation of non-linear interactions of the terms in the Navier-Stokes equations. By analysing well-known cases, the characteristics of FANS are evaluated. Particularly, we focus on physical interpretation of the terms as they relate to the interactions between modes at different timescales. Through comparison with established physics and other methods, FANS is shown to provide insight into the transfer of momentum between modes by extracting information about the contributing pressure, convective, and diffusive forces. FANS provides a simply calculated and easily interpreted set of equations to analyse flow physics by leveraging momentum conservation principles and Fourier analysis. The method is applicable to flows with complex cyclic waveforms, including broadband spectral energy distributions.


title: Predicting Gender and Political Affiliation Using Mobile Payment Data

abstract: We explore the understudied area of social payments to evaluate whether or not we can predict the gender and political affiliation of Venmo users based on the content of their Venmo transactions. Latent attribute detection has been successfully applied in the domain of studying social media. However, there remains a dearth of previous work using data other than Twitter. There is also a continued need for studies which explore mobile payments spaces like Venmo, which remain understudied due to the lack of data access. We hypothesize that using methods similar to latent attribute analysis with Twitter data, machine learning algorithms will be able to predict gender and political affiliation of Venmo users with a moderate degree of accuracy. We collected crowdsourced training data that correlates participants' political views with their public Venmo transaction history through the paid Prolific service. Additionally, we collected 21 million public Venmo transactions from recently active users to use for gender classification. We then ran the collected data through a TF-IDF vectorizer and used that to train a support vector machine (SVM). After hyperparameter training and additional feature engineering, we were able to predict user's gender with a high level of accuracy (.91) and had modest success predicting user's political orientation (.63).


title: Oriented Closed Polyhedral Maps and the Kitaev Model

abstract: A kind of combinatorial map, called arrow presentation, is proposed to encode the data of the oriented closed polyhedral complexes $\Sigma$ on which the Hopf algebraic Kitaev model lives. We develop a theory of arrow presentations which underlines the role of the dual of the double $\mathcal{D}(\Sigma)^*$ of $\Sigma$ as being the Schreier coset graph of the arrow presentation, explains the ribbon structure behind curves on $\mathcal{D}(\Sigma)^*$ and facilitates computation of holonomy with values in the algebra of the Kitaev model. In this way, we can prove ribbon operator identities for arbitrary f.d. C$^*$-Hopf algebras and arbitrary oriented closed polyhedral maps. By means of a combinatorial notion of homotopy designed specially for ribbon curves, we can rigorously formulate ''topological invariance'' of states created by ribbon operators.


title: Computing cohomology groups that classify bundles of strongly self-absorbing $C^*$-algebras

abstract: Locally trivial bundles of $C^*$-algebras with fibre $D \otimes \mathcal{K}$ for a strongly self-absorbing $C^*$-algebra $D$ over a finite CW-complex $X$ form a group $E^1_D(X)$ that is the first group of a cohomology theory $E^*_D(X)$. In this paper we compute these groups by expressing them in terms of ordinary cohomology and connective $K$-theory. To compare the $C^*$-algebraic version of $gl_1(KU)$ with its classical counterpart we also develop a uniqueness result for the unit spectrum of complex periodic topological $K$-theory.


title: A closer look at the Higgs vacuum and a model of sporadic groups

abstract: Analyzing the vacuum of the Higgs field reveals that it must have a finite symmetry. It is proposed that this finite symmetry is the Fisher-Griess monster $\mathbb{M}$ symmetry. Particularly, it is reported that the initial state of an unbroken $\mathbb{M}\times \mathbb{M}$ supersymmetry produces a mass of $1.1 \times 10^{19}$ GeV whereas the final state of a fully-broken $\mathbb{M}\times \mathbb{M}$ produces 125.4 GeV (comparable to the Planck scale $1.2 \times 10^{19}$ GeV and the Higgs boson (electroweak) scale 125.1 GeV). Also, it is shown that breaking $Weyl(E_8)\times Weyl(E_8)$ supersymmetry yields a scale of $4.4 \times 10^{16} \rm\:$GeV (comparable to the GUT scale of $2 \times 10^{16} \rm\:$GeV). Based on such evidence, therefore, the monster CFT partition function (i.e., modular invariant j-function) and the monster SCFT partition function are addressed. Next, by the Lee-Young theory, the phase transition with spontaneous symmetry breaking in the model, due to the condensation of zeros of the partition function along the unit circle, is explained. Afterward, addressing the well-known connection between the j-function and the Riemann zeta function, a match between the critical temperature of the model and the Boltzmann factor (fugacity) corresponding to the first nontrivial zero of the zeta function is reported (i.e., $T^{\ast}\cong e^{i \pi \zeta_1}$) and interpreted. Then, noting the evidence of a $\mathbb{M}$ symmetry for the Higgs field, first, the massless Photon is introduced as its trivial centralizer (the identity element $\mathbb{1}$). Finally, based on some relationships in the sporadic groups, the other 25 sporadic groups are suggested as the symmetries for the fields of 25 elementary particles (including the graviton and another particle, seemingly a leptoquark).


title: High-sensitivity graphene MEMS force and acceleration sensor based on graphene-induced non-radiative transition

abstract: The micro-electromechanical-system (MEMS) force and acceleration sensor utilizing the graphene-induced non-radiative transition was investigated. The graphene-induced non-radiative transition is very sensitive to the distance, and the deflection of the graphene ribbon is highly susceptive to applied force or acceleration. Thus, a high-sensitivity MEMS sensor can be achieved with detecting the graphene ribbon's deflection of 1 nm, the force of 0.1 pN, and the acceleration of 0.1 mg. The MEMS sensor, with a size of only tens of microns, can be charged by light irradiation without connecting power sources. In addition, it allows long-distance detection, i.e., wireless transmitter circuit can be omitted. Therefore, it will have significant application prospects in the fields of micro-smart devices, wearable devices, biomedical systems, and so on.


title: A Model Predictive Control Framework for Improving Risk-Tolerance of Manufacturing Systems

abstract: The need for control strategies that can address dynamic system uncertainty is becoming increasingly important. In this work, we propose a Model Predictive Control by quantifying the risk of failure in our system model. The proposed control scheme uses a Priced Timed Automata representation of the manufacturing system to promote the fail-safe operation of systems under uncertainties. The proposed method ensures that in case of unforeseen failure(s), the optimization-based control strategy can still achieve the manufacturing system objective. In addition, the proposed strategy establishes a trade-off between minimizing the cost and reducing failure risk to allow the manufacturing system to function effectively in the presence of uncertainties. An example from manufacturing systems is presented to show the application of the proposed control strategy.


title: Constraints on Extragalactic Background Light using TeV Observations of BL Lacertae objects

abstract: The extragalactic background light (EBL) in the IR to UV bands partly absorbs very high energy (VHE, $E \geq$ 100GeV) $\gamma-$ray photons travelling over cosmological distances via pair production. In this paper, to get stronger constraints on EBL, we use the deliberate selection of the EBL model and data of five BL Lacs with better statistics and the harder spectra to limit the EBL density and the radiation mechanism of BL Lacs. We constrain the upper limit of the EBL density by fitting the spectral energy distributions (SEDs) of TeV BL Lacs and find that our results are compatible with the published measurement, reaching 50 $\rm{nW m^{-2} sr^{-1}}$. We also obtain that the EBL is not necessarily transparent to high VHE photons. We fix the intrinsic spectral index $\Gamma_i$ of TeV BL Lacs as 1.0 and 1.5 under observation evidence and model assumption. Comparing the EBL density given by galaxy count and $Spitzer$ observations, we then obtain that 1ES 1101-232 has $\Gamma_i$ $\leq$ 1.0 and 1ES 0229+200 should have $\Gamma_i$ not harder than 1.0. We demonstrate that the common radiation assumption of BL Lacs, in which the $\Gamma_i$ is softer than 1.5, should be revisited. Furthermore, we propose that the upper EBL density could be given by fitting the hardest energy spectra of TeV BL Lacs.


title: Second order convergence of a modified MAC scheme for Stokes interface problems

abstract: Stokes flow equations have been implemented successfully in practice for simulating problems with moving interfaces. Though computational methods produce accurate solutions and numerical convergence can be demonstrated using a resolution study, the rigorous convergence proofs are usually limited to particular reformulations and boundary conditions. In this paper, a rigorous error analysis of the marker and cell (MAC) scheme for Stokes interface problems with constant viscosity in the framework of the finite difference method is presented. Without reformulating the problem into elliptic PDEs, the main idea is to use a discrete Ladyzenskaja-Babuska-Brezzi (LBB) condition and construct auxiliary functions, which satisfy discretized Stokes equations and possess at least second order accuracy in the neighborhood of the moving interface. In particular, the method, for the first time, enables one to prove second order convergence of the velocity gradient in the discrete $\ell^2$-norm, in addition to the velocity and pressure fields. Numerical experiments verify the desired properties of the methods and the expected order of accuracy for both two-dimensional and three-dimensional examples.


title: Beyond Strang: A practical assessment of some second-order 3-splitting methods

abstract: Operator splitting is a popular divide-and-conquer strategy for solving differential equations. Typically, the right-hand side of the differential equation is split into a number of parts that are then integrated separately. Many methods are known that split the right-hand side into two parts. This approach is limiting, however, and there are situations when 3-splitting is more natural and ultimately more advantageous. The second-order Strang operator-splitting method readily generalizes to a right-hand side splitting into any number of operators. It is arguably the most popular method for 3-splitting because of its efficiency, ease of implementation, and intuitive nature. Other 3-splitting methods exist, but they are less well-known, and \rev{analysis and} evaluation of their performance in practice are scarce. We demonstrate the effectiveness of some alternative 3-split, second-order methods to Strang splitting on two problems: the reaction-diffusion Brusselator, which can be split into three parts that each have closed-form solutions, and the kinetic Vlasov--Poisson equations that is used in semi-Lagrangian plasma simulations. We find alternative second-order 3-operator-splitting methods that realize efficiency gains of 10\%--20\% over traditional Strang splitting. Our analysis for the practical assessment of efficiency of operator-splitting methods includes the computational cost of the integrators and can be used in method design.

categories: math.NA cs.NA math.AP physics.comp-ph physics.flu-dyn physics.plasm-ph


title: Physics-informed neural networks with residual/gradient-based adaptive sampling methods for solving PDEs with sharp solutions

abstract: We consider solving the forward and inverse PDEs which have sharp solutions using physics-informed neural networks (PINNs) in this work. In particular, to better capture the sharpness of the solution, we propose adaptive sampling methods (ASMs) based on the residual and the gradient of the solution. We first present a residual only based ASM algorithm denoted by ASM I. In this approach, we first train the neural network by using a small number of residual points and divide the computational domain into a certain number of sub-domains, we then add new residual points in the sub-domain which has the largest mean absolute value of the residual, and those points which have largest absolute values of the residual in this sub-domain will be added as new residual points. We further develop a second type of ASM algorithm (denoted by ASM II) based on both the residual and the gradient of the solution due to the fact that only the residual may be not able to efficiently capture the sharpness of the solution. The procedure of ASM II is almost the same as that of ASM I except that in ASM II, we add new residual points which not only have large residual but also large gradient. To demonstrate the effectiveness of the present methods, we employ both ASM I and ASM II to solve a number of PDEs, including Burger equation, compressible Euler equation, Poisson equation over an L-shape domain as well as high-dimensional Poisson equation. It has been shown from the numerical results that the sharp solutions can be well approximated by using either ASM I or ASM II algorithm, and both methods deliver much more accurate solution than original PINNs with the same number of residual points. Moreover, the ASM II algorithm has better performance in terms of accuracy, efficiency and stability compared with the ASM I algorithm.


title: Detecting Stochastic Governing Laws with Observation on Stationary Distributions

abstract: Mathematical models for complex systems are often accompanied with uncertainties. The goal of this paper is to extract a stochastic differential equation governing model with observation on stationary probability distributions. We develop a neural network method to learn the drift and diffusion terms of the stochastic differential equation. We introduce a new loss function containing the Hellinger distance between the observation data and the learned stationary probability density function. We discover that the learnt stochastic differential equation provides a fair approximation of the data-driven dynamical system after minimizing this loss function during the training method. The effectiveness of our method is demonstrated in numerical experiments.


abstract: Novel ultrasonic bat deterrents based on aerodynamic whistles are investigated experimentally and numerically. The baseline deterrent, a single-whistle design inspired by Beeken [1], is examined first. It consists of two resonating cavities/chambers. The whistle is ``powered'' by a regulated high-pressure air supply and the performance of the whistle is examined for a range of supply pressures. Farfield acoustic measurements in the $20$ Hz - $50$ kHz frequency range are made in an anechoic chamber. The noise measurements are supplemented with two- and three-dimensional unsteady Reynolds-averaged Navier-Stokes (uRANS) simulations to investigate the mechanisms of ultrasound generation. The Ffowcs Williams-Hawkings acoustic analogy is used with the 3-D uRANS results to predict the far field radiation. The farfield acoustic predictions are in good agreement with the measurements in the anechoic chamber. The peak frequency (fundamental) of the radiated ultrasound of the baseline deterrent is approximately $23$ kHz. Harmonics and a sub-harmonic of the fundamental tone are also observed. The numerical simulations show that the two resonating chambers of the baseline deterrent operate out-of-phase and Helmholtz resonance determines the whistling frequency over the range of supply air pressure considered. A six-whistle deterrent targeting a broad spectral coverage in the $20-50$ kHz frequency range is designed, fabricated and tested in the anechoic chamber. Each whistle in the deterrent is obtained by geometrically scaling the baseline whistle. Measurements show that the six-whistle ultrasound deterrent generates ultrasound with six dominant peaks in the designed frequency range when the supply air pressure exceeds $5$ psig. The proposed ultrasound devices can serve as effective bat deterrents for a variety of purposes including reducing bat mortality at wind turbines.


title: Fuzzy Knowledge Distillation from High-Order TSK to Low-Order TSK

abstract: High-order Takagi-Sugeno-Kang (TSK) fuzzy classifiers possess powerful classification performance yet have fewer fuzzy rules, but always be impaired by its exponential growth training time and poorer interpretability owing to High-order polynomial used in consequent part of fuzzy rule, while Low-order TSK fuzzy classifiers run quickly with high interpretability, however they usually require more fuzzy rules and perform relatively not very well. Address this issue, a novel TSK fuzzy classifier embeded with knowledge distillation in deep learning called HTSK-LLM-DKD is proposed in this study. HTSK-LLM-DKD achieves the following distinctive characteristics: 1) It takes High-order TSK classifier as teacher model and Low-order TSK fuzzy classifier as student model, and leverages the proposed LLM-DKD (Least Learning Machine based Decoupling Knowledge Distillation) to distill the fuzzy dark knowledge from High-order TSK fuzzy classifier to Low-order TSK fuzzy classifier, which resulting in Low-order TSK fuzzy classifier endowed with enhanced performance surpassing or at least comparable to High-order TSK classifier, as well as high interpretability; specifically 2) The Negative Euclidean distance between the output of teacher model and each class is employed to obtain the teacher logits, and then it compute teacher/student soft labels by the softmax function with distillating temperature parameter; 3) By reformulating the Kullback-Leibler divergence, it decouples fuzzy dark knowledge into target class knowledge and non-target class knowledge, and transfers them to student model. The advantages of HTSK-LLM-DKD are verified on the benchmarking UCI datasets and a real dataset Cleveland heart disease, in terms of classification performance and model interpretability.


title: Lattice piecewise affine approximation of explicit nonlinear model predictive control with application to trajectory tracking of mobile robot

abstract: To promote the widespread use of mobile robots in diverse fields, the performance of trajectory tracking must be ensured. To address the constraints and nonlinear features associated with mobile robot systems, we apply nonlinear model predictive control (MPC) to realize the trajectory tracking of mobile robots. Specifically, to alleviate the online computational complexity of nonlinear MPC, this paper devises a lattice piecewise affine (PWA) approximation method that can approximate both the nonlinear system and control law of explicit nonlinear MPC. The kinematic model of the mobile robot is successively linearized along the trajectory to obtain a linear time-varying description of the system, which is then expressed using a lattice PWA model. Subsequently, the nonlinear MPC problem can be transformed into a series of linear MPC problems. Furthermore, to reduce the complexity of online calculation of multiple linear MPC problems, we approximate the optimal solution of the linear MPC by using the lattice PWA model. That is, for different sampling states, the optimal control inputs are obtained, and lattice PWA approximations are constructed for the state control pairs. Simulations are performed to evaluate the performance of our method in comparison with the linear MPC and explicit linear MPC frameworks. The results show that compared with the explicit linear MPC, our method has a higher online computing speed and can decrease the offline computing time without significantly increasing the tracking error.


title: The comparability numbers and the incomparability numbers

abstract: We introduce new cardinal invariants of a poset, called the comparability number and the incomparability number. We determine their value for well-known posets, such as $\omega^\omega$, $\mathcal{P}(\omega)/\mathrm{fin}$, the Turing degrees $\mathcal{D}$, the quotient algebra $\mathsf{Borel}(2^\omega)/\mathsf{null}$, the ideals $\mathsf{meager}$ and $\mathsf{null}$. Moreover, we consider these invariants for the Rudin-Keisler ordering of the nonprincipal ultrafilters on $\omega$. We also consider these invariants for ideals on $\omega$ and on $\omega_1$.


title: Pricing basket options with the first three moments of the basket: log-normal models and beyond

abstract: Options on baskets (linear combinations) of assets are notoriously challenging to price using even the simplest log-normal continuous-time stochastic models for the individual assets. The paper [5] gives a closed form approximation formula for pricing basket options with potentially negative portfolio weights under log-normal models by moment matching. This approximation formula is conceptually simple, methodologically sound, and turns out to be highly accurate. However it involves solving a system of nonlinear equations which usually produces multiple solutions and which is sensitive to the selection of initial values in the numerical procedures, making the method computationally challenging. In the current paper, we take the moment-matching methodology in [5] a step further by obtaining a closed form solution for this non-linear system of equations, by identifying a unary cubic equation based solely on the basket's skewness, which parametrizes all model parameters, and we use it to express the approximation formula as an explicit function of the mean, variance, and skewness of the basket. Numerical comparisons with the baskets considered in [5] show a very high level of agreement, and thus of accuracy relative to the true basket option price.


title: Probing higher-spin particles with gravitational waves from compact binary inspirals

abstract: Under the framework of gravitational effective field theory, we propose a theory agnostic strategy of searching for higher-spin particles with gravitational waves from compact binary inspirals. Using this strategy, we analyze gravitational wave signals from the binary black hole merger events GW151226 and GW170608, as well as the binary neutron star merger event GW170817. We find that the existence of higher-spin particles with mass ranged from $10^{-12} {\rm eV}$ to $10^{-11} {\rm eV}$ is strongly disfavored by these events unless the particles precisely combine within a supersymmetric supermultiplet. We argue that the gravitational effective field theory also provides a framework to search for signals beyond GR from other GW observations, such as extreme-mass-ratio-inspirals.


title: GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks

abstract: Graphs can model complex relationships between objects, enabling a myriad of Web applications such as online page/article classification and social recommendation. While graph neural networks(GNNs) have emerged as a powerful tool for graph representation learning, in an end-to-end supervised setting, their performance heavily rely on a large amount of task-specific supervision. To reduce labeling requirement, the "pre-train, fine-tune" and "pre-train, prompt" paradigms have become increasingly common. In particular, prompting is a popular alternative to fine-tuning in natural language processing, which is designed to narrow the gap between pre-training and downstream objectives in a task-specific manner. However, existing study of prompting on graphs is still limited, lacking a universal treatment to appeal to different downstream tasks. In this paper, we propose GraphPrompt, a novel pre-training and prompting framework on graphs. GraphPrompt not only unifies pre-training and downstream tasks into a common task template, but also employs a learnable prompt to assist a downstream task in locating the most relevant knowledge from the pre-train model in a task-specific manner. Finally, we conduct extensive experiments on five public datasets to evaluate and analyze GraphPrompt.


title: Balancing Privacy Protection and Interpretability in Federated Learning

abstract: Federated learning (FL) aims to collaboratively train the global model in a distributed manner by sharing the model parameters from local clients to a central server, thereby potentially protecting users' private information. Nevertheless, recent studies have illustrated that FL still suffers from information leakage as adversaries try to recover the training data by analyzing shared parameters from local clients. To deal with this issue, differential privacy (DP) is adopted to add noise to the gradients of local models before aggregation. It, however, results in the poor performance of gradient-based interpretability methods, since some weights capturing the salient region in feature map will be perturbed. To overcome this problem, we propose a simple yet effective adaptive differential privacy (ADP) mechanism that selectively adds noisy perturbations to the gradients of client models in FL. We also theoretically analyze the impact of gradient perturbation on the model interpretability. Finally, extensive experiments on both IID and Non-IID data demonstrate that the proposed ADP can achieve a good trade-off between privacy and interpretability in FL.