title: Tight-Binding Superconducting Phases in the Unconventional Compounds Strontium-Substituted Lanthanum Cuprate and Strontium Ruthenate

abstract: We use the idea of the Wigner probability distribution (WPD) in a reduced scattering phase space (RPS) for the elastic scattering cross-section, with the help of a Tight-Binding (TB) numerical procedure allowing us to consider the anisotropic quantum effects, to phenomenologically predict several phases in these two novel unconventional superconductors. Unlike our previous works with pieces of evidence that these two compounds are in the unitary strong scattering regime and that superconductivity is suppressed by the atoms of strontium in both materials, several phases are built. In the case of the strontium-substituted lanthanum cuprate, it was found three phases from one family of Wigner probabilistic distributions, one corresponding to the antiferromagnetic compound La2CuO4 another one which consists of a coalescing metallic phase for very lightly doped La2-xSrxCuO4, and finally a strong self-consistent dependent strange metal phase with optimal levels of doping. In the case of a triplet superconductor strontium ruthenate, three phases can be differentiated from two families of Wigner distribution probabilities, one family of WDP with point nodes where Cooper pairs and dressed scattered normal quasiparticles are mixed for the whole range of frequencies and which correspond to an FS $\gamma$ flat-sheet in the ground metallic state, and two phases from another WPD family, where, in one of then, the Miyake-Narikiyo quasinodal tiny gap model allows the unique presence of Cooper pairs in a tiny interval of frequencies near the superconducting transition TC, the other phase corresponds to the mixed-phase with Cooper pairs and dressed by stoichiometric strontium non-magnetic atoms, where strong self-consistent effects are noticeable. This approach allows comparing experimental results for samples in both compounds with numerical analysis studies.


title: The Ellipse of Muon Dipole Moments

abstract: We show that any new interaction resulting in a chirally-enhanced contribution to the muon magnetic moment necessarily modifies the decay rate of the Higgs boson to muon pairs or generates the muon electric dipole moment. These three observables are highly correlated, and near future measurements of $h\to \mu^+\mu^-$ will carve an ellipse in the plane of dipole moments for any such model. Together with the future measurements of the electric dipole moment many models able to explain the muon g-2 anomaly can be efficiently tested.


title: A Framework for Simulating Real-world Stream Data of the Internet of Things

abstract: With the rapid growth in the number of devices of the Internet of Things (IoT), the volume and types of stream data are rapidly increasing in the real world. Unfortunately, the stream data has the characteristics of infinite and periodic volatility in the real world, which cause problems with the inefficient stream processing tasks. In this study, we report our recent efforts on this issue, with a focus on simulating stream data. Firstly, we explore the characteristics of the real-world stream data of the IoT, which helps us to understand the stream data in the real world. Secondly, the pipeline of simulating stream data is proposed, which can accurately and efficiently simulate the characteristics of the stream data to improve efficiency for specific tasks. Finally, we design and implement a novel framework that can simulate various stream data for related stream processing tasks. To verify the validity of the proposed framework, we apply this framework to stream processing task running in the stream processing system. The experimental results reveal that the related stream processing task is accelerated by at least 24 times using our proposed simulation framework with the premise of ensuring volatility and trends of stream data.


title: Integrable Differential Systems for Deformed Laguerre-Hahn Orthogonal Polynomials

abstract: Our work studies sequences of orthogonal polynomials $ \{P_{n}(x)\}_{n=0}^{\infty} $ of the Laguerre-Hahn class, whose Stieltjes functions satisfy a Riccati type differential equation with polynomial coefficients, are subject to a deformation parameter $t$. We derive systems of differential equations and give Lax pairs, yielding non-linear differential equations in $t$ for the recurrence relation coefficients and Lax matrices of the orthogonal polynomials. A specialisation to a non semi-classical case obtained via a M\"{o}bius transformation of a Stieltjes function related to a modified Jacobi weight is studied in detail, showing this system is governed by a differential equation of the Painlev\'e type P$_\textrm{VI}$. The particular case of P$_\textrm{VI}$ arising here has the same four parameters as the solution found by Magnus [A.P. Magnus, Painlev\'e-type differential equations for the recurrence coefficients of semi-classical orthogonal polynomials, J. Comput. Appl. Math., 57:215-237, 1995] but differs in the boundary conditions.


title: Defending Against Stealthy Backdoor Attacks

abstract: Defenses against security threats have been an interest of recent studies. Recent works have shown that it is not difficult to attack a natural language processing (NLP) model while defending against them is still a cat-mouse game. Backdoor attacks are one such attack where a neural network is made to perform in a certain way on specific samples containing some triggers while achieving normal results on other samples. In this work, we present a few defense strategies that can be useful to counter against such an attack. We show that our defense methodologies significantly decrease the performance on the attacked inputs while maintaining similar performance on benign inputs. We also show that some of our defenses have very less runtime and also maintain similarity with the original inputs.


title: Ainur: A Framework for Repeatable End-to-End Wireless Edge Computing Testbed Research

abstract: Experimental research on wireless networking in combination with edge and cloud computing has been the subject of explosive interest in the last decade. This development has been driven by the increasing complexity of modern wireless technologies and the extensive softwarization of these through projects such as a Open Radio Access Network (O-RAN). In this context, a number of small- to mid-scale testbeds have emerged, employing a variety of technologies to target a wide array of use-cases and scenarios in the context of novel mobile communication technologies such as 5G and beyond-5G. Little work, however, has yet been devoted to developing a standard framework for wireless testbed automation which is hardware-agnostic and compatible with edge- and cloud-native technologies. Such a solution would simplify the development of new testbeds by completely or partially removing the requirement for custom management and orchestration software. In this paper, we present the first such mostly hardware-agnostic wireless testbed automation framework, Ainur. It is designed to configure, manage, orchestrate, and deploy workloads from an end-to-end perspective. Ainur is built on top of cloud-native technologies such as Docker, and is provided as FOSS to the community through the KTH-EXPECA/Ainur repository on GitHub. We demonstrate the utility of the platform with a series of scenarios, showcasing in particular its flexibility with respect to physical link definition, computation placement, and automation of arbitrarily complex experimental scenarios.


title: Towards a Design Framework for TNN-Based Neuromorphic Sensory Processing Units

abstract: Temporal Neural Networks (TNNs) are spiking neural networks that exhibit brain-like sensory processing with high energy efficiency. This work presents the ongoing research towards developing a custom design framework for designing efficient application-specific TNN-based Neuromorphic Sensory Processing Units (NSPUs). This paper examines previous works on NSPU designs for UCR time-series clustering and MNIST image classification applications. Current ideas for a custom design framework and tools that enable efficient software-to-hardware design flow for rapid design space exploration of application-specific NSPUs while leveraging EDA tools to obtain post-layout netlist and power-performance-area (PPA) metrics are described. Future research directions are also outlined.


title: Experience report of physics-informed neural networks in fluid simulations: pitfalls and frustration

abstract: Though PINNs (physics-informed neural networks) are now deemed as a complement to traditional CFD (computational fluid dynamics) solvers rather than a replacement, their ability to solve the Navier-Stokes equations without given data is still of great interest. This report presents our not-so-successful experiments of solving the Navier-Stokes equations with PINN as a replacement for traditional solvers. We aim to, with our experiments, prepare readers for the challenges they may face if they are interested in data-free PINN. In this work, we used two standard flow problems: 2D Taylor-Green vortex at Re=100 and 2D cylinder flow at Re=200. The PINN method solved the 2D Taylor-Green vortex problem with acceptable results, and we used this flow as an accuracy and performance benchmark. About 32 hours of training were required for the PINN method's accuracy to match the accuracy of a 16x16 finite-difference simulation, which took less than 20 seconds. The 2D cylinder flow, on the other hand, did not produce a physical solution. The PINN method behaved like a steady-flow solver and did not capture the vortex shedding phenomenon. By sharing our experience, we would like to emphasize that the PINN method is still a work-in-progress, especially in terms of solving flow problems without any given data. More work is needed to make PINN feasible for real-world problems in such applications.


title: Physical Conditions and Chemical Abundances of the Variable Planetary Nebula IC 4997

abstract: The planetary nebula (PN) IC 4997 is one of a few rapidly evolving objects with variable brightness and nebular emission around a hydrogen-deficient star. In this study, we have determined the physical conditions and chemical abundances of this object using the collisionally excited lines (CELs) and optical recombination lines (ORLs) measured from the medium-resolution spectra taken in July 2014 with the FIbre-fed \'Echelle Spectrograph on the Nordic Optical Telescope at La Palma Observatory. We derived electron densities of $\gtrsim 3 \times 10^4$ cm$^{-3}$ and electron temperatures of $\gtrsim 14,000$ K from CELs, whereas cooler temperatures of $\sim 11,000$ and $\sim 7,000$ K were obtained from helium and heavy element ORLs, respectively. The elemental abundances deduced from CELs point to a metal-poor progenitor with [O/H]$\lesssim-0.75$, whereas the ORL abundances are slightly above the solar metallicity, [O/H]$\approx 0.15$. Our abundance analysis indicates that the abundance discrepancy factors (ADFs$\equiv$ORLs/CELs) of this PN are relatively large: ADF(O$^{2+})\gtrsim 8$ and ADF(N$^{2+})\gtrsim 7$. Further research is needed to find out how the ADFs and variable emissions are formed in this object and whether they are associated with a binary companion or a very late thermal pulse.


title: Is it Worth to Reason about Uncertainty in Occupancy Grid Maps during Path Planning?

abstract: This paper investigates the usefulness of reasoning about the uncertain presence of obstacles during path planning, which typically stems from the usage of probabilistic occupancy grid maps for representing the environment when mapping via a noisy sensor like a stereo camera. The traditional planning paradigm prescribes using a hard threshold on the occupancy probability to declare that a cell is an obstacle, and to plan a single path accordingly while treating unknown space as free. We compare this approach against a new uncertainty-aware planner, which plans two different path hypotheses and then merges their initial trajectory segments into a single one ending in a "next-best view" pose. After this informative view is taken, the planner commits to one of the hypotheses, or to a completely new one if a collision is imminent. Simulations were conducted comparing the proposed and traditional planner. Results show the existence of planning scenarios -- like when the environment contains a dead-end, or when the goal is placed close to an obstacle -- in which reasoning about uncertainty can significantly decrease the robot's traveled distance and increase the chances of reaching the goal. The new planner was also validated on a real Clearpath Jackal robot equipped with a ZED 2 stereo camera.


title: Self-supervised models of audio effectively explain human cortical responses to speech

abstract: Self-supervised language models are very effective at predicting high-level cortical responses during language comprehension. However, the best current models of lower-level auditory processing in the human brain rely on either hand-constructed acoustic filters or representations from supervised audio neural networks. In this work, we capitalize on the progress of self-supervised speech representation learning (SSL) to create new state-of-the-art models of the human auditory system. Compared against acoustic baselines, phonemic features, and supervised models, representations from the middle layers of self-supervised models (APC, wav2vec, wav2vec 2.0, and HuBERT) consistently yield the best prediction performance for fMRI recordings within the auditory cortex (AC). Brain areas involved in low-level auditory processing exhibit a preference for earlier SSL model layers, whereas higher-level semantic areas prefer later layers. We show that these trends are due to the models' ability to encode information at multiple linguistic levels (acoustic, phonetic, and lexical) along their representation depth. Overall, these results show that self-supervised models effectively capture the hierarchy of information relevant to different stages of speech processing in human cortex.


title: Analysis of the Ensemble Kalman--Bucy Filter for correlated observation noise

abstract: Ensemble Kalman--Bucy filters (EnKBFs) are an important tool in Data Assimilation that aim to approximate the posterior distribution for continuous time filtering problems using an ensemble of interacting particles. In this work we extend a previously derived unifying framework for consistent representations of the posterior distribution to correlated observation noise and use these representations to derive an EnKBF suitable for this setting as a constant gain approximation of these optimal filters. Existence and uniqueness results for both the EnKBF and its mean field limit are provided. The existence and uniqueness of solutions to its limiting McKean-Vlasov equation does not seem to be covered by the existing literature. In the correlated noise case the evolution of the ensemble depends also on the pseudoinverse of its empirical covariance matrix, which has to be controlled for global well posedness. These bounds may also be of independent interest. Finally the convergence to the mean field limit is proven. The results can also be extended to other versions of EnKBFs.


title: Reflections on the Physics and Astronomy Student Reading Society (PhASRS) at San Jose State University

abstract: The COVID-19 pandemic imposed profound changes on the way we think about undergraduate physics education. Online courses became mainstream. Exam formats were reimagined. Digital whiteboards replaced face-to-face discussions. Laboratory classes were outfitted with home-delivered supply kits. And all of us developed a more intimate knowledge of Greek letters and symbols (delta, omicron, etc.) than we might have comfortably liked to admit. Having weathered these transformations from the point of view of both an undergraduate student (S.L.J.) and classroom instructors (A.H. and C.L.S.), we have found that among the most challenging aspects of the in-person learning experience to replicate in an online environment have been the relational ones. To highlight some of the ways in which these issues can be mitigated, we report here on the activities of the San Jose State University (SJSU) Physics and Astronomy Student Reading Society (PhASRS), which was an online reading group at SJSU founded by ourselves and others running from the summer of 2020 until the end of the fall 2020 semester. Elements of the reading group's structure and guiding principles are described, as well as student and faculty reflections on what worked well and what did not. The manuscript underlines the power of astronomy- and physics-themed journal clubs as vehicles for learning and more generally emphasizes the importance of community-building initiatives in the discipline. Our hope is that this summary of activities will inspire faculty members and students at colleges and perhaps high schools to imagine new possibilities for developing communities of people in science that might not otherwise be able to exist.


title: Dips at small sizes for topological graph obstruction sets

abstract: The Graph Minor Theorem of Robertson and Seymour implies a finite set of obstructions for any minor closed graph property. We show that there are only three obstructions to knotless embedding of size 23, which is far fewer than the 92 of size 22 and the hundreds known to exist at larger sizes. We describe several other topological properties whose obstruction set demonstrates a similar dip at small size. For order ten graphs, we classify the 35 obstructions to knotless embedding and the 49 maximal knotless graphs.


title: The Common Envelope Evolution Outcome -- A Case Study on Hot Subdwarf B Stars

abstract: Common envelope evolution (CEE) physics plays a fundamental role in the formation of binary systems, such as mergering stellar gravitational wave sources, pulsar binaries and type Ia supernovae. A precisely constrained CEE has become more important in the age of large surveys and gravitational wave detectors. We use an adiabatic mass loss model to explore how the total energy of the donor changes as a function of the remnant mass. This provides a more self-consistent way to calculate the binding energy of the donor. For comparison, we also calculate the binding energy through integrating the total energy from the core to the surface. The outcome of CEE is constrained by total energy conservation at the point at which both component's radii shrink back within their Roche lobes. We apply our results to 142 hot subdwarf binaries. For shorter orbital period sdBs, the binding energy is highly consistent. For longer orbital period sdBs in our samples, the binding energy can differ by up to a factor of 2. The CE efficiency parameter $\beta_\mathrm{CE}$ becomes smaller than $\alpha_\mathrm{CE}$ for the final orbital period $\log_{10} P_{\mathrm{orb}}/\mathrm{d} > -0.5$. We also find the mass ratios $\log_{10} q$ and CE efficiency parameters $\log_{10} \alpha_{\mathrm{CE}}$ and $\log_{10} \beta_{\mathrm{CE}}$ linearly correlate in sdBs, similarly to De Marco et al. (2010) for post-AGB binaries.


title: Stable, entropy-pressure compatible subsonic Riemann boundary condition for embedded DG compressible flow simulations

abstract: One approach to reduce the cost to simulate transitional compressible boundary layer flow is to adopt a near body reduced domain with boundary conditions enforced to be compatible with a computationally cheaper 3D RANS simulation. In such an approach it is desirable to enforce a consistent pressure distribution which is not typically the case when using the standard Riemann inflow boundary condition. We revisit the Riemann problem adopted in many DG based high fidelity formulations. Through analysis of the 1D linearised Euler equations it is demonstrated that maintaining entropy compatibility with the RANS simulation is important for a stable solution. The maintenance of Riemann invariant at outflow leaves one condition that can be imposed at the inflow. Therefore the entropy-pressure enforcement is the only stable boundary condition to enforce a known pressure distribution. We further demonstrate that all the entropy compatible inflow Riemann boundary conditions are stable providing the invariant compatible Riemann outflow boundary condition is also respected. Although the entropy-pressure compatible Riemann inflow boundary condition is stable from the 1D analysis, 2D tests highlight divergence in the inviscid problem and neutrally stable wiggles in the velocity fields in viscous simulations around the stagnation point. A 2D analysis about a non-uniform baseflow assumption provides insight into this stability issue (ill-posedness) and motivate the use of a mix of inflow boundary conditions in this region of the flow. As a validation we apply the proposed boundary conditions to a reduced domain of a wing section normal to the leading-edge of the CRM-NLF model taken out of a full 3D RANS simulation at Mach 0.86 and a Reynolds number of 8.5 million. The results show that the entropy-pressure compatible Riemann inflow boundary condition leads to a good agreement in pressure distribution.


title: On the Symmetries of Deep Learning Models and their Internal Representations

abstract: Symmetry is a fundamental tool in the exploration of a broad range of complex systems. In machine learning symmetry has been explored in both models and data. In this paper we seek to connect the symmetries arising from the architecture of a family of models with the symmetries of that family's internal representation of data. We do this by calculating a set of fundamental symmetry groups, which we call the intertwiner groups of the model. We connect intertwiner groups to a model's internal representations of data through a range of experiments that probe similarities between hidden states across models with the same architecture. Our work suggests that the symmetries of a network are propagated into the symmetries in that network's representation of data, providing us with a better understanding of how architecture affects the learning and prediction process. Finally, we speculate that for ReLU networks, the intertwiner groups may provide a justification for the common practice of concentrating model interpretability exploration on the activation basis in hidden layers rather than arbitrary linear combinations thereof.


title: Personalized PageRank Graph Attention Networks

abstract: There has been a rising interest in graph neural networks (GNNs) for representation learning over the past few years. GNNs provide a general and efficient framework to learn from graph-structured data. However, GNNs typically only use the information of a very limited neighborhood for each node to avoid over-smoothing. A larger neighborhood would be desirable to provide the model with more information. In this work, we incorporate the limit distribution of Personalized PageRank (PPR) into graph attention networks (GATs) to reflect the larger neighbor information without introducing over-smoothing. Intuitively, message aggregation based on Personalized PageRank corresponds to infinitely many neighborhood aggregation layers. We show that our models outperform a variety of baseline models for four widely used benchmark datasets. Our implementation is publicly available online.


title: A Note on the Fibonacci Sequence and Schreier-type Sets

abstract: A set $A$ of positive integers is said to be Schreier if either $A = \emptyset$ or $\min A\ge |A|$. We give a bijective map to prove the recurrence of the sequence $(|\mathcal{K}_{n, p, q}|)_{n=1}^\infty$ (for fixed $p\ge 1$ and $q\ge 2$), where $$\mathcal{K}_{n, p, q} \ = \ \{A\subset \{1, \ldots, n\}\,:\, \mbox{either }A = \emptyset \mbox{ or } (\max A-\max_2 A = p\mbox{ and }\min A\ge |A|\ge q)\}$$ and $\max_2 A$ is the second largest integer in $A$, given that $|A|\ge 2$. When $p = 1$ and $q=2$, we have that $(|\mathcal{K}_{n, 1, 2}|)_{n=1}^\infty$ is the Fibonacci sequence. As a corollary, we obtain a new combinatorial interpretation for the sequence $(F_n + n)_{n=1}^\infty$.


title: Nonlinear dielectric relaxation of polar liquids

abstract: Molecular dynamics of two water models, SPC/E and TIP3P, at a number of temperatures is used to test the Kivelson-Madden equation connecting single-particle and collective dielectric relaxation times through the Kirkwood factor. The relation is confirmed by simulations and used to estimate the nonlinear effect of the electric field on the dielectric relaxation time. We show that the main effect of the field comes through slowing down of the single-particle rotational dynamics and the relative contribution of the field-induced alteration of the Kirkwood factor is insignificant for water. Theories of nonlinear dielectric relaxation need to mostly account for the effect of the field on rotations of a single dipole in a polar liquid.


title: Individual ion species chemical potentials in the Mean Spherical Approximation

abstract: The Mean Spherical Approximation (MSA) is a commonly-used thermodynamic theory for computing the energetics of ions in the primitive model (i.e., charged hard-sphere ions in a background dielectric). For the excess chemical potential, however, the early MSA formulations (which were widely adopted) only included the terms needed to compute the mean excess chemical potential (or the mean activity coefficient). Other terms for the chemical potential $\mu_i$ of individual species $i$ were not included because they sum to $0$ in the mean chemical potential. Here, we derive these terms to give a complete MSA formulation of the chemical potential. The result is a simple additive term for $\mu_i$ that we show is a qualitative improvement over the previous MSA version. In addition, our derivation shows that the MSA's assumption of global charge neutrality is not strictly necessary, so that the MSA is also valid for systems close to neutrality.


title: Optimal Multi-robot Formations for Relative Pose Estimation Using Range Measurements

abstract: In multi-robot missions, relative position and attitude information between agents is valuable for a variety of tasks such as mapping, planning, and formation control. In this paper, the problem of estimating relative poses from a set of inter-agent range measurements is investigated. Specifically, it is shown that the estimation accuracy is highly dependent on the true relative poses themselves, which prompts the desire to find multi-agent formations that provide the best estimation performance. By direct maximization of Fischer information, it is shown in simulation and experiment that large improvements in estimation accuracy can be obtained by optimizing the formation geometry of a team of robots.


title: The Analysis of Optimization Algorithms, A Dissipativity Approach

abstract: Optimization problems in engineering and applied mathematics are typically solved in an iterative fashion, by systematically adjusting the variables of interest until an adequate solution is found. The iterative algorithms that govern these systematic adjustments can be viewed as a control system. In control systems, the output in measured and the input is adjusted using feedback to drive the error to zero. Similarly, in iterative algorithms, the optimization objective is evaluated and the candidate solution is adjusted to drive it toward the optimal point. Choosing an algorithm that works well for a variety of optimization problems is akin to robust controller design. Just as dissipativity theory can be used to analyze the stability properties of control systems, it can also be used to analyze the convergence properties of iterative algorithms. By defining an appropriate notion of "energy" that dissipates with every iteration of the algorithm, the convergence properties of the algorithm can be characterized. This article formalizes the connection between iterative algorithms and control systems and shows through examples how dissipativity theory can be used to analyze the performance of many classes of optimization algorithms. This control-theoretic viewpoint enables the selection and tuning of optimization algorithms to be performed in an automated and systematic way.


title: A Low-complexity Brain-computer Interface for High-complexity Robot Swarm Control

abstract: A brain-computer interface (BCI) is a system that allows a human operator to use only mental commands in controlling end effectors that interact with the world around them. Such a system consists of a measurement device to record the human user's brain activity, which is then processed into commands that drive a system end effector. BCIs involve either invasive measurements which allow for high-complexity control but are generally infeasible, or noninvasive measurements which offer lower quality signals but are more practical to use. In general, BCI systems have not been developed that efficiently, robustly, and scalably perform high-complexity control while retaining the practicality of noninvasive measurements. Here we leverage recent results from feedback information theory to fill this gap by modeling BCIs as a communications system and deploying a human-implementable interaction algorithm for noninvasive control of a high-complexity robot swarm. We construct a scalable dictionary of robotic behaviors that can be searched simply and efficiently by a BCI user, as we demonstrate through a large-scale user study testing the feasibility of our interaction algorithm, a user test of the full BCI system on (virtual and real) robot swarms, and simulations that verify our results against theoretical models. Our results provide a proof of concept for how a large class of high-complexity effectors (even beyond robotics) can be effectively controlled by a BCI system with low-complexity and noisy inputs.


title: Simulation of the isotropic ultra-high energy photons flux in the solar magnetic field

abstract: Both the lack of observation of ultra-high energy (UHE) photons and the limitations of the state-of-the-art methodology being applied for their identification motivate studies on alternative approaches to the relevant simulations and the related observational strategies. One of such new approaches is proposed in this report and it concerns new observables allowing indirect identification of UHE photons through cosmic ray phenomena composed of many spatially correlated extensive air showers or primary cosmic rays observed at one time. The study is based on simulations of interactions of UHE photons with the magnetic field of the Sun using the PRESHOWER program with some essential modifications. One of the expected results of such interactions is a generation of cosmic ray ensembles (CRE) in the form of very thin and very elongated cascades of secondary photons of energies spanning the whole cosmic ray energy spectrum. Upon entering the Earth's atmosphere, these cascades or their parts may generate uniquely characteristic walls of spatially correlated extensive air showers, and the effect is expected also in cases when primary UHE photons are not directed towards the Earth. Particle distributions in these multi-primary UHE photon footprints are expected to have thicknesses of the order of meters and elongations reaching even hundreds of millions kilometers, making them potentially observable with a global, multi-experiment approach, including re-exploring of the historical data, with the expected event rate exceeding the capabilities of even very large cosmic ray observatories. The methods described in this report allow for simulating potentially observable quantities related to CRE induced by UHE photons: densities, energy spectra and geographical orientations of particles at the top of the Earth's atmosphere.


title: An algorithm for finding weakly reversible deficiency zero realizations of polynomial dynamical systems

abstract: Systems of differential equations with polynomial right-hand sides are very common in applications. On the other hand, their mathematical analysis is very challenging in general, due to the possibility of complex dynamics: multiple basins of attraction, oscillations, and even chaotic dynamics. Even if we restrict our attention to mass-action systems, all of these complex dynamical behaviours are still possible. On the other hand, if a polynomial dynamical system has a weakly reversible deficiency zero ($WR_0$) realization, then its dynamics is known to be remarkably simple: oscillations and chaotic dynamics are ruled out and, up to linear conservation laws, there exists a single positive steady state, which is asymptotically stable. Here we describe an algorithm for finding $WR_0$ realizations of polynomial dynamical systems, whenever such realizations exist.


title: NeuPSL: Neural Probabilistic Soft Logic

abstract: In this paper, we introduce Neural Probabilistic Soft Logic (NeuPSL), a novel neuro-symbolic (NeSy) framework that unites state-of-the-art symbolic reasoning with the low-level perception of deep neural networks. To model the boundary between neural and symbolic representations, we propose a family of energy-based models, NeSy Energy-Based Models, and show that they are general enough to include NeuPSL and many other NeSy approaches. Using this framework, we show how to seamlessly integrate neural and symbolic parameter learning and inference in NeuPSL. Through an extensive empirical evaluation, we demonstrate the benefits of using NeSy methods, achieving upwards of 30% improvement over independent neural network models. On a well-established NeSy task, MNIST-Addition, NeuPSL demonstrates its joint reasoning capabilities by outperforming existing NeSy approaches by up to 10% in low-data settings. Furthermore, NeuPSL achieves a 5% boost in performance over state-of-the-art NeSy methods in a canonical citation network task with up to a 40 times speed up.


title: Temporal graph patterns by timed automata

abstract: Temporal graphs represent graph evolution over time, and have been receiving considerable research attention. Work on expressing temporal graph patterns or discovering temporal motifs typically assumes relatively simple temporal constraints, such as journeys or, more generally, existential constraints, possibly with finite delays. In this paper we propose to use timed automata to express temporal constraints, leading to a general and powerful notion of temporal basic graph pattern (BGP). The new difficulty is the evaluation of the temporal constraint on a large set of matchings. An important benefit of timed automata is that they support an iterative state assignment, which can be useful for early detection of matches and pruning of non-matches. We introduce algorithms to retrieve all instances of a temporal BGP match in a graph, and present results of an extensive experimental evaluation, demonstrating interesting performance trade-offs. We show that an on-demand algorithm that processes total matchings incrementally over time is preferable when dealing with cyclic patterns on sparse graphs. On acyclic patterns or dense graphs, and when connectivity of partial matchings can be guaranteed, the best performance is achieved by maintaining partial matchings over time and allowing automaton evaluation to be fully incremental.


title: A Referee Primer for Early Career Astronomers

abstract: Refereeing is a crucial component of publishing astronomical research, but few professional astronomers receive formal training on how to effectively referee a manuscript. In this article, we lay out considerations and best practices for referees. This document is intended as a tool for early career researchers to develop a fair, effective, and efficient approach to refereeing.


title: Towards Communication-Learning Trade-off for Federated Learning at the Network Edge

abstract: In this letter, we study a wireless federated learning (FL) system where network pruning is applied to local users with limited resources. Although pruning is beneficial to reduce FL latency, it also deteriorates learning performance due to the information loss. Thus, a trade-off problem between communication and learning is raised. To address this challenge, we quantify the effects of network pruning and packet error on the learning performance by deriving the convergence rate of FL with a non-convex loss function. Then, closed-form solutions for pruning control and bandwidth allocation are proposed to minimize the weighted sum of FL latency and FL performance. Finally, numerical results demonstrate that 1) our proposed solution can outperform benchmarks in terms of cost reduction and accuracy guarantee, and 2) a higher pruning rate would bring less communication overhead but also worsen FL accuracy, which is consistent with our theoretical analysis.


title: Cupid Is Not Doomed Yet: On the Stability of the Inner Moons of Uranus

abstract: Some of the small inner moons of Uranus have very closely-spaced orbits. Multiple numerical studies have found that the moons Cressida and Desdemona, within the Portia sub-group, are likely to collide in less than 100 Myr. The subsequent discovery of three new moons (Cupid, Perdita, and Mab) made the system even more crowded. In particular, it has been suggested that the Belinda group (Cupid, Belinda, and Perdita) will become unstable in as little as 10$^5$ years. Here we revisit the issue of the stability of the inner moons of Uranus using updated orbital elements and considering tidal dissipation. We find that the Belinda group can be stable on $10^8$-year timescales due to an orbital resonance between Belinda and Perdita. We find that tidal evolution cannot form the Belinda-Perdita resonance, but convergent migration could contribute to the long-term instability of the Portia group. We propose that Belinda captured Perdita into the resonance during the last episode of disruption and re-accretion among the inner moons, possibly hundreds of Myr ago.


title: A New Semi-Structured Algebraic Multigrid Method

abstract: Multigrid methods are well suited to large massively parallel computer architectures because they are mathematically optimal and display excellent parallelization properties. Since current architecture trends are favoring regular compute patterns to achieve high performance, the ability to express structure has become much more important. The hypre software library provides high-performance multigrid preconditioners and solvers through conceptual interfaces, including a semi-structured interface that describes matrices primarily in terms of stencils and logically structured grids. This paper presents a new semi-structured algebraic multigrid (SSAMG) method built on this interface. The numerical convergence and performance of a CPU implementation of this method are evaluated for a set of semi-structured problems. SSAMG achieves significantly better setup times than hypre's unstructured AMG solvers and comparable convergence. In addition, the new method is capable of solving more complex problems than hypre's structured solvers.


title: Light charged Higgs boson in $H^\pm h$ associated production at the LHC

abstract: We investigate the light charged Higgs boson production via $pp \rightarrow H^\pm h$ at the Large Hadron Collider (LHC) in the Two-Higgs Doublet Model (2HDM) type-I. By focusing on a scenario where $H$ is the observed Higgs boson of mass 125 GeV, we study the aforementioned Higgs boson production channel and explore its bosonic decay $H^\pm \rightarrow W^\pm h$. The latter can have a sizable rate that possibly dominates, over the fermionic decay channels, in several regions of the viable parameter space. We demonstrate that the production process $pp \rightarrow H^\pm h$ followed by $H^\pm \rightarrow W^\pm h$ could be the most promising experimental avenue to search for light $H^\pm$ at the LHC.


title: Image Keypoint Matching using Graph Neural Networks

abstract: Image matching is a key component of many tasks in computer vision and its main objective is to find correspondences between features extracted from different natural images. When images are represented as graphs, image matching boils down to the problem of graph matching which has been studied intensively in the past. In recent years, graph neural networks have shown great potential in the graph matching task, and have also been applied to image matching. In this paper, we propose a graph neural network for the problem of image matching. The proposed method first generates initial soft correspondences between keypoints using localized node embeddings and then iteratively refines the initial correspondences using a series of graph neural network layers. We evaluate our method on natural image datasets with keypoint annotations and show that, in comparison to a state-of-the-art model, our method speeds up inference times without sacrificing prediction accuracy.


title: So3krates: Equivariant attention for interactions on arbitrary length-scales in molecular systems

abstract: The application of machine learning methods in quantum chemistry has enabled the study of numerous chemical phenomena, which are computationally intractable with traditional ab-initio methods. However, some quantum mechanical properties of molecules and materials depend on non-local electronic effects, which are often neglected due to the difficulty of modeling them efficiently. This work proposes a modified attention mechanism adapted to the underlying physics, which allows to recover the relevant non-local effects. Namely, we introduce spherical harmonic coordinates (SPHCs) to reflect higher-order geometric information for each atom in a molecule, enabling a non-local formulation of attention in the SPHC space. Our proposed model So3krates - a self-attention based message passing neural network - uncouples geometric information from atomic features, making them independently amenable to attention mechanisms. Thereby we construct spherical filters, which extend the concept of continuous filters in Euclidean space to SPHC space and serve as foundation for a spherical self-attention mechanism. We show that in contrast to other published methods, So3krates is able to describe non-local quantum mechanical effects over arbitrary length scales. Further, we find evidence that the inclusion of higher-order geometric correlations increases data efficiency and improves generalization. So3krates matches or exceeds state-of-the-art performance on popular benchmarks, notably, requiring a significantly lower number of parameters (0.25 - 0.4x) while at the same time giving a substantial speedup (6 - 14x for training and 2 - 11x for inference) compared to other models.


title: Monte Carlo Tree Search Gait Planner for Non-Gaited Legged System Control

abstract: In this work, a non-gaited framework for legged system locomotion is presented. The approach decouples the gait sequence optimization by considering the problem as a decision-making process. The redefined contact sequence problem is solved by utilizing a Monte Carlo Tree Search (MCTS) algorithm that exploits optimization-based simulations to evaluate the best search direction. The proposed scheme has proven to have a good trade-off between exploration and exploitation of the search space compared to the state-of-the-art Mixed-Integer Quadratic Programming (MIQP). The model predictive control (MPC) utilizes the gait generated by the MCTS to optimize the ground reaction forces and future footholds position. The simulation results, performed on a quadruped robot, showed that the proposed framework could generate known periodic gait and adapt the contact sequence to the encountered conditions, including external forces and terrain with unknown and variable properties. When tested on robots with different layouts, the system has also shown its reliability.


title: Generalization Bounds of Nonconvex-(Strongly)-Concave Stochastic Minimax Optimization

abstract: This paper takes an initial step to systematically investigate the generalization bounds of algorithms for solving nonconvex-(strongly)-concave (NC-SC/NC-C) stochastic minimax optimization measured by the stationarity of primal functions. We first establish algorithm-agnostic generalization bounds via uniform convergence between the empirical minimax problem and the population minimax problem. The sample complexities for achieving $\epsilon$-generalization are $\tilde{\mathcal{O}}(d\kappa^2\epsilon^{-2})$ and $\tilde{\mathcal{O}}(d\epsilon^{-4})$ for NC-SC and NC-C settings, respectively, where $d$ is the dimension and $\kappa$ is the condition number. We further study the algorithm-dependent generalization bounds via stability arguments of algorithms. In particular, we introduce a novel stability notion for minimax problems and build a connection between generalization bounds and the stability notion. As a result, we establish algorithm-dependent generalization bounds for stochastic gradient descent ascent (SGDA) algorithm and the more general sampling-determined algorithms.


title: Basically regular local homomorphisms

abstract: We investigate the transfer of regularity between commutative, noetherian, local rings through a class of local homomorphisms which we call basically regular. We give numerical characterizations of these maps, investigate their behavior under composition and decomposition, and compare them with Avramov-Foxby-Herzog's weakly regular local homomorphisms.


title: Fast Object Placement Assessment

abstract: Object placement assessment (OPA) aims to predict the rationality score of a composite image in terms of the placement (e.g., scale, location) of inserted foreground object. However, given a pair of scaled foreground and background, to enumerate all the reasonable locations, existing OPA model needs to place the foreground at each location on the background and pass the obtained composite image through the model one at a time, which is very time-consuming. In this work, we investigate a new task named as fast OPA. Specifically, provided with a scaled foreground and a background, we only pass them through the model once and predict the rationality scores for all locations. To accomplish this task, we propose a pioneering fast OPA model with several innovations (i.e., foreground dynamic filter, background prior transfer, and composite feature mimicking) to bridge the performance gap between slow OPA model and fast OPA model. Extensive experiments on OPA dataset show that our proposed fast OPA model performs on par with slow OPA model but runs significantly faster.


title: SHORTSTACK: Distributed, Fault-tolerant, Oblivious Data Access

abstract: Many applications that benefit from data offload to cloud services operate on private data. A now-long line of work has shown that, even when data is offloaded in an encrypted form, an adversary can learn sensitive information by analyzing data access patterns. Existing techniques for oblivious data access-that protect against access pattern attacks-require a centralized and stateful trusted proxy to orchestrate data accesses from applications to cloud services. We show that, in failure-prone deployments, such a centralized and stateful proxy results in violation of oblivious data access security guarantees and/or system unavailability. We thus initiate the study of distributed, fault-tolerant, oblivious data access. We present SHORTSTACK, a distributed proxy architecture for oblivious data access in failure-prone deployments. SHORTSTACK achieves the classical obliviousness guarantee--access patterns observed by the adversary being independent of the input--even under a powerful passive persistent adversary that can force failure of arbitrary (bounded-sized) subset of proxy servers at arbitrary times. We also introduce a security model that enables studying oblivious data access with distributed, failure-prone, servers. We provide a formal proof that SHORTSTACK enables oblivious data access under this model, and show empirically that SHORTSTACK performance scales near-linearly with number of distributed proxy servers.


title: Investigating End-user Acceptance of Last-mile Delivery by Autonomous Vehicles in the United States

abstract: This paper investigates the end-user acceptance of last-mile delivery carried out by autonomous vehicles within the United States. A total of 296 participants were presented with information on this technology and then asked to complete a questionnaire on their perceptions to gauge their behavioral intention concerning acceptance. Structural equation modeling of the partial least squares flavor (PLS-SEM) was employed to analyze the collected data. The results indicated that the perceived usefulness of the technology played the greatest role in end-user acceptance decisions, followed by the influence of others, and then the enjoyment received by interacting with the technology. Furthermore, the perception of risk associated with using autonomous delivery vehicles for last-mile delivery led to a decrease in acceptance. However, most participants did not perceive the use of this technology to be risky. The paper concludes by summarizing the implications our findings have on the respective stakeholders and proposing the next steps in this area of research.


title: Rethinking Bayesian Learning for Data Analysis: The Art of Prior and Inference in Sparsity-Aware Modeling

abstract: Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and b) generative methods. The latter, more widely known as Bayesian methods, enable uncertainty evaluation w.r.t. the performed predictions. Furthermore, they can better exploit related prior information and naturally introduce robustness into the model, due to their unique capacity to marginalize out uncertainties related to the parameter estimates. Moreover, hyper-parameters associated with the adopted priors can be learnt via the training data. To implement sparsity-aware learning, the crucial point lies in the choice of the function regularizer for discriminative methods and the choice of the prior distribution for Bayesian learning. Over the last decade or so, due to the intense research on deep learning, emphasis has been put on discriminative techniques. However, a come back of Bayesian methods is taking place that sheds new light on the design of deep neural networks, which also establish firm links with Bayesian models and inspire new paths for unsupervised learning, such as Bayesian tensor decomposition. The goal of this article is two-fold. First, to review, in a unified way, some recent advances in incorporating sparsity-promoting priors into three highly popular data modeling tools, namely deep neural networks, Gaussian processes, and tensor decomposition. Second, to review their associated inference techniques from different aspects, including: evidence maximization via optimization and variational inference methods. Challenges such as small data dilemma, automatic model structure search, and natural prediction uncertainty evaluation are also discussed. Typical signal processing and machine learning tasks are demonstrated.


title: Provably Auditing Ordinary Least Squares in Low Dimensions

abstract: Measuring the stability of conclusions derived from Ordinary Least Squares linear regression is critically important, but most metrics either only measure local stability (i.e. against infinitesimal changes in the data), or are only interpretable under statistical assumptions. Recent work proposes a simple, global, finite-sample stability metric: the minimum number of samples that need to be removed so that rerunning the analysis overturns the conclusion, specifically meaning that the sign of a particular coefficient of the estimated regressor changes. However, besides the trivial exponential-time algorithm, the only approach for computing this metric is a greedy heuristic that lacks provable guarantees under reasonable, verifiable assumptions; the heuristic provides a loose upper bound on the stability and also cannot certify lower bounds on it. We show that in the low-dimensional regime where the number of covariates is a constant but the number of samples is large, there are efficient algorithms for provably estimating (a fractional version of) this metric. Applying our algorithms to the Boston Housing dataset, we exhibit regression analyses where we can estimate the stability up to a factor of $3$ better than the greedy heuristic, and analyses where we can certify stability to dropping even a majority of the samples.


title: P2M-DeTrack: Processing-in-Pixel-in-Memory for Energy-efficient and Real-Time Multi-Object Detection and Tracking

abstract: Today's high resolution, high frame rate cameras in autonomous vehicles generate a large volume of data that needs to be transferred and processed by a downstream processor or machine learning (ML) accelerator to enable intelligent computing tasks, such as multi-object detection and tracking. The massive amount of data transfer incurs significant energy, latency, and bandwidth bottlenecks, which hinders real-time processing. To mitigate this problem, we propose an algorithm-hardware co-design framework called Processing-in-Pixel-in-Memory-based object Detection and Tracking (P2M-DeTrack). P2M-DeTrack is based on a custom faster R-CNN-based model that is distributed partly inside the pixel array (front-end) and partly in a separate FPGA/ASIC (back-end). The proposed front-end in-pixel processing down-samples the input feature maps significantly with judiciously optimized strided convolution and pooling. Compared to a conventional baseline design that transfers frames of RGB pixels to the back-end, the resulting P2M-DeTrack designs reduce the data bandwidth between sensor and back-end by up to 24x. The designs also reduce the sensor and total energy (obtained from in-house circuit simulations at Globalfoundries 22nm technology node) per frame by 5.7x and 1.14x, respectively. Lastly, they reduce the sensing and total frame latency by an estimated 1.7x and 3x, respectively. We evaluate our approach on the multi-object object detection (tracking) task of the large-scale BDD100K dataset and observe only a 0.5% reduction in the mean average precision (0.8% reduction in the identification F1 score) compared to the state-of-the-art.


title: High-throughput computation and structure prototype analysis for two-dimensional ferromagnetic materials

abstract: We perform high-throughput first-principles computations to search the high Curie temperature ($T_{\rm C}$) two-dimensional ferromagnetic (2DFM) materials. We identify 79 2DFM materials and calculate their $T_{\rm C}$, in which Co$_2$F$_2$ has the highest $T_{\rm C}$=541K, well above the room temperature. The 79 2DFM materials are classified into different structural prototypes according to their structural similarity. We perform sure independence screening and sparsifying operator (SISSO) analysis to explore the relation between $T_{\rm C}$ and the material structures. The results suggest that the 2DFM materials with shorter distance between the magnetic atoms, larger local magnetic moments and more neighboring magnetic atoms are more likely to have higher $T_{\rm C}$.


title: Triple-Band Scheduling with Millimeter Wave and Terahertz Bands for Wireless Backhaul

abstract: With the explosive growth of mobile traffic demand, densely deployed small cells underlying macrocells have great potential for 5G and beyond wireless networks. In this paper, we consider the problem of supporting traffic flows with diverse QoS requirements by exploiting three high frequency bands, i.e., the 28GHz band, the E-band, and the Terahertz (THz) band. The cooperation of the three bands is helpful for maximizing the number of flows with their QoS requirements satisfied. To solve the formulated nonlinear integer programming problem, we propose a triple-band scheduling scheme which can select the optimum scheduling band for each flow among three different frequency bands. The proposed scheme also efficiently utilizes the resource to schedule flow transmissions in time slots. Extensive simulations demonstrate the superior performance of the proposed scheme over three baseline schemes with respect to the number of completed flows and the system throughput.


title: Few-shot Subgoal Planning with Language Models

abstract: Pre-trained large language models have shown successful progress in many language understanding benchmarks. This work explores the capability of these models to predict actionable plans in real-world environments. Given a text instruction, we show that language priors encoded in pre-trained language models allow us to infer fine-grained subgoal sequences. In contrast to recent methods which make strong assumptions about subgoal supervision, our experiments show that language models can infer detailed subgoal sequences from few training sequences without any fine-tuning. We further propose a simple strategy to re-rank language model predictions based on interaction and feedback from the environment. Combined with pre-trained navigation and visual reasoning components, our approach demonstrates competitive performance on subgoal prediction and task completion in the ALFRED benchmark compared to prior methods that assume more subgoal supervision.


title: Contrastive Learning for Multi-Modal Automatic Code Review

abstract: Automatic code review (ACR), aiming to relieve manual inspection costs, is an indispensable and essential task in software engineering. The existing works only use the source code fragments to predict the results, missing the exploitation of developer's comments. Thus, we present a Multi-Modal Apache Automatic Code Review dataset (MACR) for the Multi-Modal ACR task. The release of this dataset would push forward the research in this field. Based on it, we propose a Contrastive Learning based Multi-Modal Network (CLMN) to deal with the Multi-Modal ACR task. Concretely, our model consists of a code encoding module and a text encoding module. For each module, we use the dropout operation as minimal data augmentation. Then, the contrastive learning method is adopted to pre-train the module parameters. Finally, we combine the two encoders to fine-tune the CLMN to decide the results of Multi-Modal ACR. Experimental results on the MACR dataset illustrate that our proposed model outperforms the state-of-the-art methods.


title: Building net-native agreement systems

abstract: Agreements and contracts are everywhere, but they are built on layers and layers of legal and social institutions. Software is slowly entering into this stack. In this article, we introduce agreement paths, a general model for understanding and decomposing digital agreement systems, and Agreement Engine, an open-source software service for building net-native agreement systems. We demonstrate Agreement Engine by building two example agreement systems: Scarce Knowledge, an app for crowdfunding essays, and Twitter Social Capital, a bot that allows users to form and enforce Twitter agreements.


title: Boundary pointwise regularity and Liouville theorems for fully nonlinear equations on cones

abstract: In this paper, we prove a boundary pointwise regularity for fully nonlinear elliptic equations on cones. In addition, based on this regularity, we give simple proofs of the Liouville theorems on cones.


title: BulletArm: An Open-Source Robotic Manipulation Benchmark and Learning Framework

abstract: We present BulletArm, a novel benchmark and learning-environment for robotic manipulation. BulletArm is designed around two key principles: reproducibility and extensibility. We aim to encourage more direct comparisons between robotic learning methods by providing a set of standardized benchmark tasks in simulation alongside a collection of baseline algorithms. The framework consists of 31 different manipulation tasks of varying difficulty, ranging from simple reaching and picking tasks to more realistic tasks such as bin packing and pallet stacking. In addition to the provided tasks, BulletArm has been built to facilitate easy expansion and provides a suite of tools to assist users when adding new tasks to the framework. Moreover, we introduce a set of five benchmarks and evaluate them using a series of state-of-the-art baseline algorithms. By including these algorithms as part of our framework, we hope to encourage users to benchmark their work on any new tasks against these baselines.


title: Detection of Flare-induced Plasma Flows in the Corona of EV Lac with X-ray Spectroscopy

abstract: Stellar flares are characterized by sudden enhancement of electromagnetic radiation from the atmospheres of stars. Compared to their solar counterparts, our knowledge on the coronal plasma dynamics of stellar flares and their connection to coronal mass ejections (CMEs) remains very limited. With time-resolved high-resolution spectroscopic observations from the \textit{Chandra} X-ray observatory, we detected noticeable coronal plasma flows during several stellar flares on a nearby dMe star EV Lac. In the observed spectra of O~{\sc{viii}} (3 MK), Fe~{\sc{xvii}} (6 MK), Mg~{\sc{xii}} (10 MK), and Si~{\sc{xiv}} (16 MK) lines, these flare-induced upflows/downflows appear as significant Doppler shifts of several tens to \speed{130}, and the upflow velocity generally increases with temperature. Variable line ratios of the Si~{\sc{xiii}} triplet reveal that these plasma flows in most flares are accompanied by an increase of the coronal plasma density and temperature. We interpret these results as X-ray evidences for chromospheric evaporation on EV Lac. In two successive flares, the plasma flow pattern and a sharp increase of the measured coronal density are highly suggestive of explosive evaporation. The transition from redshifts to blueshifts in such an explosive evaporation occurs at a temperature of at least 10 MK, much higher than that observed in solar flares ($\sim$1 MK). However, in one flare the cool and warm upflows appear to be accompanied by a decreasing plasma density, which might be explained by a stellar filament/prominence eruption coupled to this flare. These results provide important clues to understand the coronal plasma dynamics during flares on M dwarfs.


title: Deep Representation Decomposition for Rate-Invariant Speaker Verification

abstract: While promising performance for speaker verification has been achieved by deep speaker embeddings, the advantage would reduce in the case of speaking-style variability. Speaking rate mismatch is often observed in practical speaker verification systems, which may actually degrade the system performance. To reduce intra-class discrepancy caused by speaking rate, we propose a deep representation decomposition approach with adversarial learning to learn speaking rate-invariant speaker embeddings. Specifically, adopting an attention block, we decompose the original embedding into an identity-related component and a rate-related component through multi-task training. Additionally, to reduce the latent relationship between the two decomposed components, we further propose a cosine mapping block to train the parameters adversarially to minimize the cosine similarity between the two decomposed components. As a result, identity-related features become robust to speaking rate and then are used for verification. Experiments are conducted on VoxCeleb1 data and HI-MIA data to demonstrate the effectiveness of our proposed approach.


title: Is Lip Region-of-Interest Sufficient for Lipreading?

abstract: Lip region-of-interest (ROI) is conventionally used for visual input in the lipreading task. Few works have adopted the entire face as visual input because lip-excluded parts of the face are usually considered to be redundant and irrelevant to visual speech recognition. However, faces contain much more detailed information than lips, such as speakers' head pose, emotion, identity etc. We argue that such information might benefit visual speech recognition if a powerful feature extractor employing the entire face is trained. In this work, we propose to adopt the entire face for lipreading with self-supervised learning. AV-HuBERT, an audio-visual multi-modal self-supervised learning framework, was adopted in our experiments. Our experimental results showed that adopting the entire face achieved 16% relative word error rate (WER) reduction on the lipreading task, compared with the baseline method using lip as visual input. Without self-supervised pretraining, the model with face input achieved a higher WER than that using lip input in the case of limited training data (30 hours), while a slightly lower WER when using large amount of training data (433 hours).


title: On the Complexity of Maximizing Social Welfare within Fair Allocations of Indivisible Goods

abstract: We consider the classical fair division problem which studies how to allocate resources fairly and efficiently. We give a complete landscape on the computational complexity and approximability of maximizing the social welfare within (1) envy-free up to any item (EFX) and (2) envy-free up to one item (EF1) allocations of indivisible goods for both normalized and unnormalized valuations. We show that a partial EFX allocation may have a higher social welfare than a complete EFX allocation, while it is well-known that this is not true for EF1 allocations. Thus, our first group of results focuses on the problem of maximizing social welfare subject to (partial) EFX allocations. For $n=2$ agents, we provide a polynomial time approximation scheme (PTAS) and an NP-hardness result. For a general number of agents $n>2$, we present algorithms that achieve approximation ratios of $O(n)$ and $O(\sqrt{n})$ for unnormalized and normalized valuations, respectively. These results are complemented by the asymptotically tight inapproximability results. We also study the same constrained optimization problem for EF1. For $n=2$, we show a fully polynomial time approximation scheme (FPTAS) and complement this positive result with an NP-hardness result. For general $n$, we present polynomial inapproximability ratios for both normalized and unnormalized valuations. Our results also imply the price of EFX is $\Theta(\sqrt{n})$ for normalized valuations, which is unknown in the previous literature.


title: Fake It Till You Make It: Towards Accurate Near-Distribution Novelty Detection

abstract: We aim for image-based novelty detection. Despite considerable progress, existing models either fail or face a dramatic drop under the so-called "near-distribution" setting, where the differences between normal and anomalous samples are subtle. We first demonstrate existing methods experience up to 20% decrease in performance in the near-distribution setting. Next, we propose to exploit a score-based generative model to produce synthetic near-distribution anomalous data. Our model is then fine-tuned to distinguish such data from the normal samples. We provide a quantitative as well as qualitative evaluation of this strategy, and compare the results with a variety of GAN-based models. Effectiveness of our method for both the near-distribution and standard novelty detection is assessed through extensive experiments on datasets in diverse applications such as medical images, object classification, and quality control. This reveals that our method considerably improves over existing models, and consistently decreases the gap between the near-distribution and standard novelty detection performance. The code repository is available at https://github.com/rohban-lab/FITYMI.


title: MC-GEN:Multi-level Clustering for Private Synthetic Data Generation

abstract: With the development of machine learning and data science, data sharing is very common between companies and research institutes to avoid data scarcity. However, sharing original datasets that contain private information can cause privacy leakage. A reliable solution is to utilize private synthetic datasets which preserve statistical information from original datasets. In this paper, we propose MC-GEN, a privacy-preserving synthetic data generation method under differential privacy guarantee for machine learning classification tasks. MC-GEN applies multi-level clustering and differential private generative model to improve the utility of synthetic data. In the experimental evaluation, we evaluated the effects of parameters and the effectiveness of MC-GEN. The results showed that MC-GEN can achieve significant effectiveness under certain privacy guarantees on multiple classification tasks. Moreover, we compare MC-GEN with three existing methods. The results showed that MC-GEN outperforms other methods in terms of utility.


title: Deep Learning with Label Noise: A Hierarchical Approach

abstract: Deep neural networks are susceptible to label noise. Existing methods to improve robustness, such as meta-learning and regularization, usually require significant change to the network architecture or careful tuning of the optimization procedure. In this work, we propose a simple hierarchical approach that incorporates a label hierarchy when training the deep learning models. Our approach requires no change of the network architecture or the optimization procedure. We investigate our hierarchical network through a wide range of simulated and real datasets and various label noise types. Our hierarchical approach improves upon regular deep neural networks in learning with label noise. Combining our hierarchical approach with pre-trained models achieves state-of-the-art performance in real-world noisy datasets.


title: Tuning Frequency Bias in Neural Network Training with Nonuniform Data

abstract: Small generalization errors of over-parameterized neural networks (NNs) can be partially explained by the frequency biasing phenomenon, where gradient-based algorithms minimize the low-frequency misfit before reducing the high-frequency residuals. Using the Neural Tangent Kernel (NTK), one can provide a theoretically rigorous analysis for training where data are drawn from constant or piecewise-constant probability densities. Since most training data sets are not drawn from such distributions, we use the NTK model and a data-dependent quadrature rule to theoretically quantify the frequency biasing of NN training given fully nonuniform data. By replacing the loss function with a carefully selected Sobolev norm, we can further amplify, dampen, counterbalance, or reverse the intrinsic frequency biasing in NN training.


title: Uncertainty quantification of two-phase flow in porous media via coupled-TgNN surrogate model

abstract: Uncertainty quantification (UQ) of subsurface two-phase flow usually requires numerous executions of forward simulations under varying conditions. In this work, a novel coupled theory-guided neural network (TgNN) based surrogate model is built to facilitate computation efficiency under the premise of satisfactory accuracy. The core notion of this proposed method is to bridge two separate blocks on top of an overall network. They underlie the TgNN model in a coupled form, which reflects the coupling nature of pressure and water saturation in the two-phase flow equation. The TgNN model not only relies on labeled data, but also incorporates underlying scientific theory and experiential rules (e.g., governing equations, stochastic parameter fields, boundary and initial conditions, well conditions, and expert knowledge) as additional components into the loss function. The performance of the TgNN-based surrogate model for two-phase flow problems is tested by different numbers of labeled data and collocation points, as well as the existence of data noise. The proposed TgNN-based surrogate model offers an effective way to solve the coupled nonlinear two-phase flow problem and demonstrates good accuracy and strong robustness when compared with the purely data-driven surrogate model. By combining the accurate TgNN-based surrogate model with the Monte Carlo method, UQ tasks can be performed at a minimum cost to evaluate statistical quantities. Since the heterogeneity of the random fields strongly impacts the results of the surrogate model, corresponding variance and correlation length are added to the input of the neural network to maintain its predictive capacity. The results show that the TgNN-based surrogate model achieves satisfactory accuracy, stability, and efficiency in UQ problems of subsurface two-phase flow.

categories: physics.flu-dyn cs.AI cs.LG physics.comp-ph


title: Examination of background effects on light-nuclei yield ratio in relativistic heavy-ion collisions

abstract: The light-nuclei yield ratio is one of the candidates to probe the critical fluctuations of hot QCD matter. In this paper, we investigate the \textit{background effects}, namely the non-critical effects coming from the non-trivial thermal background, on the light-nuclei production within the framework of the coalescence model. Specifically, we analyze the impact of the equilibrium phase-space distribution function of nucleons, $f(\mathbf{r},\mathbf{p})$, on the light-nuclei yield ratio $N_tN_p/N_d^2$, where $N_t$, $N_p$, and $N_d$ denote triton, proton, and deuteron yields. By considering the characteristic function of the phase-space distribution, we systematically expand the yield of light nuclei of $A$-constituent nucleons, $N_A$, in terms of the \textit{phase-space cumulants}, $\langle\mathbf{r}^n\mathbf{p}^m\rangle_c$. We find that the cumulants up to the second-order are canceled out in the generalized ratio $N_p^{B-A} N_B^{A-1}/N_A^{B-1}$. This means that the dominant background effects including the fireball size, the kinetic freeze-out temperature, and the coordinate--momentum correlations caused by the radial expansion play an insignificant role in the yield ratio, which supports the yield ratio as a useful tool for the critical-point search. We also show several examples of background phase-space distributions for the qualitative illustration. The higher-order cumulants, which correspond to the non-Gaussian shape of the phase-space profile, play an important role in the variation of the yield ratio particularly for the smaller fireball sizes. Qualitatively, the spatial structure of the background decreases the yield ratio, and the azimuthal anisotropy $v_n$ increases it. The higher order of the azimuthal anisotropy causes a larger effect on the yield ratio. These results call for the comprehensive future studies of the yield ratio using sophisticated dynamical models.


title: Deep Embedded Clustering with Distribution Consistency Preservation for Attributed Networks

abstract: Many complex systems in the real world can be characterized by attributed networks. To mine the potential information in these networks, deep embedded clustering, which obtains node representations and clusters simultaneously, has been paid much attention in recent years. Under the assumption of consistency for data in different views, the cluster structure of network topology and that of node attributes should be consistent for an attributed network. However, many existing methods ignore this property, even though they separately encode node representations from network topology and node attributes meanwhile clustering nodes on representation vectors learnt from one of the views. Therefore, in this study, we propose an end-to-end deep embedded clustering model for attributed networks. It utilizes graph autoencoder and node attribute autoencoder to respectively learn node representations and cluster assignments. In addition, a distribution consistency constraint is introduced to maintain the latent consistency of cluster distributions of two views. Extensive experiments on several datasets demonstrate that the proposed model achieves significantly better or competitive performance compared with the state-of-the-art methods. The source code can be found at https://github.com/Zhengymm/DCP.


title: Multimodal Fake News Detection via CLIP-Guided Learning

abstract: Multimodal fake news detection has attracted many research interests in social forensics. Many existing approaches introduce tailored attention mechanisms to guide the fusion of unimodal features. However, how the similarity of these features is calculated and how it will affect the decision-making process in FND are still open questions. Besides, the potential of pretrained multi-modal feature learning models in fake news detection has not been well exploited. This paper proposes a FND-CLIP framework, i.e., a multimodal Fake News Detection network based on Contrastive Language-Image Pretraining (CLIP). Given a targeted multimodal news, we extract the deep representations from the image and text using a ResNet-based encoder, a BERT-based encoder and two pair-wise CLIP encoders. The multimodal feature is a concatenation of the CLIP-generated features weighted by the standardized cross-modal similarity of the two modalities. The extracted features are further processed for redundancy reduction before feeding them into the final classifier. We introduce a modality-wise attention module to adaptively reweight and aggregate the features. We have conducted extensive experiments on typical fake news datasets. The results indicate that the proposed framework has a better capability in mining crucial features for fake news detection. The proposed FND-CLIP can achieve better performances than previous works, i.e., 0.7\%, 6.8\% and 1.3\% improvements in overall accuracy on Weibo, Politifact and Gossipcop, respectively. Besides, we justify that CLIP-based learning can allow better flexibility on multimodal feature selection.


title: Ensemble2: Anomaly Detection via EVT-Ensemble Framework for Seasonal KPIs in Communication Network

abstract: KPI anomaly detection is one important function of network management system. Traditional methods either require prior knowledge or manually set thresholds. To overcome these shortcomings, we propose the Ensemble2 framework, which applies ensemble learning to improve exogenous capabilities. Meanwhile, automatically adjusts thresholds based on extreme value theory. The model is tested on production datasets to verify its effectiveness. We further optimize the model using online learning, and finally running at a speed of ~10 pts/s on an Intel i5 platform.


title: Multipartite Entanglement in the Random Ising Chain

abstract: Quantifying entanglement of multiple subsystems is a challenging open problem in interacting quantum systems. Here, we focus on two subsystems of length $\ell$ separated by a distance $r=\alpha\ell$ and quantify their entanglement negativity (${\cal E}$) and mutual information (${\cal I}$) in critical random Ising chains. Both the disorder averaged ${\cal E}$ and ${\cal I}$ are found to be scale-invariant and universal, i.e. independent of the form of disorder. We find a constant ${\cal E}(\alpha)$ and ${\cal I}(\alpha)$ over any distances, using the asymptotically exact strong disorder renormalization group method. Our results are qualitatively different from both those in the clean Ising model and random spin chains of a singlet ground state, like the spin-$\frac{1}{2}$ random Heisenberg chain and the random XX chain. While for random singlet states ${\cal I}(\alpha)/{\cal E}(\alpha)=2$, in the random Ising chain this universal ratio is strongly $\alpha$-dependent. This deviation between systems contrasts with the behavior of the entanglement entropy of a single subsystem, for which the various random critical chains and clean models give the same qualitative behavior. Therefore, studying multipartite entanglement provides additional universal information in random quantum systems, beyond what we can learn from a single subsystem.


title: TFLEX: Temporal Feature-Logic Embedding Framework for Complex Reasoning over Temporal Knowledge Graph

abstract: Multi-hop logical reasoning over knowledge graph (KG) plays a fundamental role in many artificial intelligence tasks. Recent complex query embedding (CQE) methods for reasoning focus on static KGs, while temporal knowledge graphs (TKGs) have not been fully explored. Reasoning over TKGs has two challenges: 1. The query should answer entities or timestamps; 2. The operators should consider both set logic on entity set and temporal logic on timestamp set. To bridge this gap, we define the multi-hop logical reasoning problem on TKGs. With generated three datasets, we propose the first temporal CQE named Temporal Feature-Logic Embedding framework (TFLEX) to answer the temporal complex queries. We utilize vector logic to compute the logic part of Temporal Feature-Logic embeddings, thus naturally modeling all First-Order Logic (FOL) operations on entity set. In addition, our framework extends vector logic on timestamp set to cope with three extra temporal operators (After, Before and Between). Experiments on numerous query patterns demonstrate the effectiveness of our method.


title: Transfer Learning-based Channel Estimation in Orthogonal Frequency Division Multiplexing Systems Using Data-nulling Superimposed Pilots

abstract: Data-nulling superimposed pilot (DNSP) effectively alleviates the superimposed interference of superimposed training (ST)-based channel estimation (CE) in orthogonal frequency division multiplexing (OFDM) systems, while facing the challenges of the estimation accuracy and computational complexity. By developing the promising solutions of deep learning (DL) in the physical layer of wireless communication, we fuse the DNSP and DL to tackle these challenges in this paper. Nevertheless, due to the changes of wireless scenarios, the model mismatch of DL leads to the performance degradation of CE, and thus faces the issue of network retraining. To address this issue, a lightweight transfer learning (TL) network is further proposed for the DL-based DNSP scheme, and thus structures a TL-based CE in OFDM systems. Specifically, based on the linear receiver, the least squares estimation is first employed to extract the initial features of CE. With the extracted features, we develop a convolutional neural network (CNN) to fuse the solutions of DLbased CE and the CE of DNSP. Finally, a lightweight TL network is constructed to address the model mismatch. To this end, a novel CE network for the DNSP scheme in OFDM systems is structured, which improves its estimation accuracy and alleviates the model mismatch. The experimental results show that in all signal-to-noise-ratio (SNR) regions, the proposed method achieves lower normalized mean squared error (NMSE) than the existing DNSP schemes with minimum mean square error (MMSE)-based CE. For example, when the SNR is 0 decibel (dB), the proposed scheme achieves similar NMSE as that of the MMSE-based CE scheme at 20 dB, thereby significantly improving the estimation accuracy of CE. In addition, relative to the existing schemes, the improvement of the proposed scheme presents its robustness against the impacts of parameter variations.


title: Federated Neural Bandits

abstract: Recent works on neural contextual bandits have achieved compelling performances due to their ability to leverage the strong representation power of neural networks (NNs) for reward prediction. Many applications of contextual bandits involve multiple agents who collaborate without sharing raw observations, thus giving rise to the setting of federated contextual bandits. Existing works on federated contextual bandits rely on linear or kernelized bandits, which may fall short when modeling complex real-world reward functions. So, this paper introduces the federated neural-upper confidence bound (FN-UCB) algorithm. To better exploit the federated setting, FN-UCB adopts a weighted combination of two UCBs: $\text{UCB}^{a}$ allows every agent to additionally use the observations from the other agents to accelerate exploration (without sharing raw observations), while $\text{UCB}^{b}$ uses an NN with aggregated parameters for reward prediction in a similar way to federated averaging for supervised learning. Notably, the weight between the two UCBs required by our theoretical analysis is amenable to an interesting interpretation, which emphasizes $\text{UCB}^{a}$ initially for accelerated exploration and relies more on $\text{UCB}^{b}$ later after enough observations have been collected to train the NNs for accurate reward prediction (i.e., reliable exploitation). We prove sub-linear upper bounds on both the cumulative regret and the number of communication rounds of FN-UCB, and empirically demonstrate its competitive performance.


title: Approximate Conditional Coverage & Calibration via Neural Model Approximations

abstract: A typical desideratum for quantifying the uncertainty from a classification model as a prediction set is class-conditional singleton set calibration. That is, such sets should map to the output of well-calibrated selective classifiers, matching the observed frequencies of similar instances. Recent works proposing adaptive and localized conformal p-values for deep networks do not guarantee this behavior, nor do they achieve it empirically. Instead, we use the strong signals for prediction reliability from KNN-based approximations of Transformer networks to construct data-driven partitions for Mondrian Conformal Predictors, which are treated as weak selective classifiers that are then calibrated via a new Inductive Venn Predictor, the Venn-ADMIT Predictor. The resulting selective classifiers are well-calibrated, in a conservative but practically useful sense for a given threshold. They are inherently robust to changes in the proportions of the data partitions, and straightforward conservative heuristics provide additional robustness to covariate shifts. We compare and contrast to the quantities produced by recent Conformal Predictors on several representative and challenging natural language processing classification tasks, including class-imbalanced and distribution-shifted settings.


title: MolScribe: Robust Molecular Structure Recognition with Image-To-Graph Generation

abstract: Molecular structure recognition is the task of translating a molecular image into its graph structure. Significant variation in drawing styles and conventions exhibited in chemical literature poses a significant challenge for automating this task. In this paper, we propose MolScribe, a novel image-to-graph generation model that explicitly predicts atoms and bonds, along with their geometric layouts, to construct the molecular structure. Our model flexibly incorporates symbolic chemistry constraints to recognize chirality and expand abbreviated structures. We further develop data augmentation strategies to enhance the model robustness against domain shifts. In experiments on both synthetic and realistic molecular images, MolScribe significantly outperforms previous models, achieving 76-93% accuracy on public benchmarks. Chemists can also easily verify MolScribe's prediction, informed by its confidence estimation and atom-level alignment with the input image. MolScribe is publicly available through Python and web interfaces: https://github.com/thomas0809/MolScribe.


title: Fine-Grained Buy-Many Mechanisms Are Not Much Better Than Bundling

abstract: Multi-item revenue-optimal mechanisms are known to be extremely complex, often offering buyers randomized lotteries of goods. In the standard buy-one model, it is known that optimal mechanisms can yield revenue infinitely higher than that of any "simple" mechanism -- the ones with size polynomial in the number of items -- even with just two items and a single buyer (Briest et al. 2015, Hart and Nisan 2017). We introduce a new parameterized class of mechanisms, buy-$k$ mechanisms, which smoothly interpolate between the classical buy-one mechanisms and the recently studied buy-many mechanisms (Chawla et al. 2019, Chawla et al. 2020, Chawla et al. 2022). Buy-$k$ mechanisms allow the buyer to buy up to $k$ many menu options. We show that restricting the seller to the class of buy-$n$ incentive-compatible mechanisms suffices to overcome the bizarre, infinite revenue properties of the buy-one model. Our main result is that the revenue gap with respect to bundling, an extremely simple mechanism, is bounded by $O(n^2)$ for any arbitrarily correlated distribution $\mathcal{D}$ over $n$ items for the case of an additive buyer. Our techniques also allow us to prove similar upper bounds for arbitrary monotone valuations, albeit with an exponential factor in the approximation. On the negative side, we show that allowing the buyer to purchase a small number of menu options does not suffice to guarantee sub-exponential approximations, even when we weaken the benchmark to the optimal buy-$k$ deterministic mechanism. If an additive buyer is only allowed to buy $k = \Theta(n^{1/2-\varepsilon})$ many menu options, the gap between the revenue-optimal deterministic buy-$k$ mechanism and bundling may be exponential in $n$. In particular, this implies that no "simple" mechanism can obtain a sub-exponential approximation in this regime.


title: Learning to Use Chopsticks in Diverse Gripping Styles

abstract: Learning dexterous manipulation skills is a long-standing challenge in computer graphics and robotics, especially when the task involves complex and delicate interactions between the hands, tools and objects. In this paper, we focus on chopsticks-based object relocation tasks, which are common yet demanding. The key to successful chopsticks skills is steady gripping of the sticks that also supports delicate maneuvers. We automatically discover physically valid chopsticks holding poses by Bayesian Optimization (BO) and Deep Reinforcement Learning (DRL), which works for multiple gripping styles and hand morphologies without the need of example data. Given as input the discovered gripping poses and desired objects to be moved, we build physics-based hand controllers to accomplish relocation tasks in two stages. First, kinematic trajectories are synthesized for the chopsticks and hand in a motion planning stage. The key components of our motion planner include a grasping model to select suitable chopsticks configurations for grasping the object, and a trajectory optimization module to generate collision-free chopsticks trajectories. Then we train physics-based hand controllers through DRL again to track the desired kinematic trajectories produced by the motion planner. We demonstrate the capabilities of our framework by relocating objects of various shapes and sizes, in diverse gripping styles and holding positions for multiple hand morphologies. Our system achieves faster learning speed and better control robustness, when compared to vanilla systems that attempt to learn chopstick-based skills without a gripping pose optimization module and/or without a kinematic motion planner.


title: On a singular limit of the Kobayashi--Warren--Carter energy

abstract: By introducing a new topology, a representation formula of the Gamma limit of the Kobayashi-Warren-Carter energy is given in a multi-dimensional domain. A key step is to study the Gamma limit of a single-well Modica-Mortola functional. The convergence introduced here is called the sliced graph convergence, which is finer than conventional $L^1$ convergence, and the problem is reduced to a one-dimensional setting by a slicing argument.


title: Efficient Federated Learning with Spike Neural Networks for Traffic Sign Recognition

abstract: With the gradual popularization of self-driving, it is becoming increasingly important for vehicles to smartly make the right driving decisions and autonomously obey traffic rules by correctly recognizing traffic signs. However, for machine learning-based traffic sign recognition on the Internet of Vehicles (IoV), a large amount of traffic sign data from distributed vehicles is needed to be gathered in a centralized server for model training, which brings serious privacy leakage risk because of traffic sign data containing lots of location privacy information. To address this issue, we first exploit privacy-preserving federated learning to perform collaborative training for accurate recognition models without sharing raw traffic sign data. Nevertheless, due to the limited computing and energy resources of most devices, it is hard for vehicles to continuously undertake complex artificial intelligence tasks. Therefore, we introduce powerful Spike Neural Networks (SNNs) into traffic sign recognition for energy-efficient and fast model training, which is the next generation of neural networks and is practical and well-fitted to IoV scenarios. Furthermore, we design a novel encoding scheme for SNNs based on neuron receptive fields to extract information from the pixel and spatial dimensions of traffic signs to achieve high-accuracy training. Numerical results indicate that the proposed federated SNN outperforms traditional federated convolutional neural networks in terms of accuracy, noise immunity, and energy efficiency as well.


title: Rayleigh-Taylor instability under multi-mode perturbation: discrete Boltzmann modeling with tracers

abstract: The Rayleigh-Taylor Instability (RTI) under multi-mode perturbation in compressible flow is probed via the Discrete Boltzmann Modeling (DBM) with tracers. The distribution of tracers provides clear boundaries between light and heavy fluids in the position space. Besides, the position-velocity phase space offers a new perspective for understanding the flow behavior of RTI with intuitive geometrical correspondence. The effects of viscosity, acceleration, compressibility, and Atwood number on the mixing of material and momentum and the mean non-equilibrium strength at the interfaces are investigated separately based on both the mixedness defined by the tracers and the non-equilibrium strength defined by the DBM. The mixedness increases with viscosity during early stage but decreases with viscosity at the later stage. Acceleration, compressibility, and Atwood number show enhancement effects on mixing based on different mechanisms. After the system relaxes from the initial state, the mean non-equilibrium strength at the interfaces presents an initially increasing and then declining trend, which is jointly determined by the interface length and the macroscopic physical quantity gradient. We conclude that the four factors investigated all significantly affect early evolution behavior of RTI system, such as the competition between interface length and macroscopic physical quantity gradient. The results contribute to the understanding of the multi-mode RTI evolutionary mechanism and the accompanied kinetic effects.


title: A Confidence Machine for Sparse High-Order Interaction Model

abstract: In predictive modeling for high-stake decision-making, predictors must be not only accurate but also reliable. Conformal prediction (CP) is a promising approach for obtaining the confidence of prediction results with fewer theoretical assumptions. To obtain the confidence set by so-called full-CP, we need to refit the predictor for all possible values of prediction results, which is only possible for simple predictors. For complex predictors such as random forests (RFs) or neural networks (NNs), split-CP is often employed where the data is split into two parts: one part for fitting and another to compute the confidence set. Unfortunately, because of the reduced sample size, split-CP is inferior to full-CP both in fitting as well as confidence set computation. In this paper, we develop a full-CP of sparse high-order interaction model (SHIM), which is sufficiently flexible as it can take into account high-order interactions among variables. We resolve the computational challenge for full-CP of SHIM by introducing a novel approach called homotopy mining. Through numerical experiments, we demonstrate that SHIM is as accurate as complex predictors such as RF and NN and enjoys the superior statistical power of full-CP.


title: Learning Math Reasoning from Self-Sampled Correct and Partially-Correct Solutions

abstract: Pretrained language models have shown superior performance on many natural language processing tasks, yet they still struggle at multi-step formal reasoning tasks like grade school math problems. One key challenge of finetuning them to solve such math reasoning problems is that many existing datasets only contain one reference solution for each problem, despite the fact that there are often alternative solutions resembling different reasoning paths to the final answer. This way, the finetuned models are biased towards the limited reference solutions, which limits their generalization to unseen examples. To mitigate this issue, we propose to let the model perform sampling during training and learn from both self-sampled fully-correct solutions, which yield the correct answer upon execution, and partially-correct solutions, whose intermediate state matches an intermediate state of a known correct solution. We show that our use of self-sampled correct and partially-correct solutions can benefit learning and help guide the sampling process, leading to more efficient exploration of the solution space. Additionally, we explore various training objectives to support learning from multiple solutions per example and find they greatly affect the performance. Experiments on two math reasoning datasets show the effectiveness of our method compared to learning from a single reference solution with MLE, where we improve PASS@100 from 35.5% to 44.5% for GSM8K, and 27.6% to 36.2% PASS@80 for MathQA. Such improvements are also consistent across different model sizes. Our code is available at https://github.com/microsoft/TraceCodegen.


title: WT-MVSNet: Window-based Transformers for Multi-view Stereo

abstract: Recently, Transformers were shown to enhance the performance of multi-view stereo by enabling long-range feature interaction. In this work, we propose Window-based Transformers (WT) for local feature matching and global feature aggregation in multi-view stereo. We introduce a Window-based Epipolar Transformer (WET) which reduces matching redundancy by using epipolar constraints. Since point-to-line matching is sensitive to erroneous camera pose and calibration, we match windows near the epipolar lines. A second Shifted WT is employed for aggregating global information within cost volume. We present a novel Cost Transformer (CT) to replace 3D convolutions for cost volume regularization. In order to better constrain the estimated depth maps from multiple views, we further design a novel geometric consistency loss (Geo Loss) which punishes unreliable areas where multi-view consistency is not satisfied. Our WT multi-view stereo method (WT-MVSNet) achieves state-of-the-art performance across multiple datasets and ranks $1^{st}$ on Tanks and Temples benchmark.