title: Identifying Patient-Specific Root Causes of Disease

abstract: Complex diseases are caused by a multitude of factors that may differ between patients. As a result, hypothesis tests comparing all patients to all healthy controls can detect many significant variables with inconsequential effect sizes. A few highly predictive root causes may nevertheless generate disease within each patient. In this paper, we define patient-specific root causes as variables subject to exogenous "shocks" which go on to perturb an otherwise healthy system and induce disease. In other words, the variables are associated with the exogenous errors of a structural equation model (SEM), and these errors predict a downstream diagnostic label. We quantify predictivity using sample-specific Shapley values. This derivation allows us to develop a fast algorithm called Root Causal Inference for identifying patient-specific root causes by extracting the error terms of a linear SEM and then computing the Shapley value associated with each error. Experiments highlight considerable improvements in accuracy because the method uncovers root causes that may have large effect sizes at the individual level but clinically insignificant effect sizes at the group level. An R implementation is available at github.com/ericstrobl/RCI.


title: Entanglement dynamics: Generalized master equation for uniformly accelerated two-level systems

abstract: We propose a new form for the quantum master equation in the theory of open quantum systems. This new formalism allows one to describe the dynamics of two-level systems moving along different hyperbolic trajectories with distinct proper times. In the Born-Markov approximation, we consider a quantum massless scalar field coupled with two-level systems. Starting from a separable state we show the emergence of entanglement harvesting. For different proper accelerations we verify also the entanglement sudden death.


title: Cosmology and Non-additive Entropy

abstract: Non-additive entropies have been proposed as alternatives to understanding the thermodynamics of Black Holes. Moreover, it has been suggested that the difficulties of quantization of gravity are an indication that gravity is an emergent phenomenon, and therefore an entropic formulation is warranted. In this work, we explore cosmologies that come from non-additive entropies. We focus our study on the cosmologies derived from entropies in superstatistics.


title: A sharp threshold for a random version of Sperner's Theorem

abstract: The Boolean lattice $\mathcal{P}(n)$ consists of all subsets of $[n] = \{1,\dots, n\}$ partially ordered under the containment relation. Sperner's Theorem states that the largest antichain of the Boolean lattice is given by a middle layer: the collection of all sets of size $\lfloor{n/2}\rfloor$, or also, if $n$ is odd, the collection of all sets of size $\lceil{n/2}\rceil$. Given $p$, choose each subset of $[n]$ with probability $p$ independently. We show that for every constant $p>3/4$, the largest antichain among these subsets is also given by a middle layer, with probability tending to $1$ as $n$ tends to infinity. This $3/4$ is best possible, and we also characterize the largest antichains for every constant $p>1/2$. Our proof is based on some new variations of Sapozhenko's graph container method.


title: Towards Opening the Black Box of Neural Machine Translation: Source and Target Interpretations of the Transformer

abstract: In Neural Machine Translation (NMT), each token prediction is conditioned on the source sentence and the target prefix (what has been previously translated at a decoding step). However, previous work on interpretability in NMT has mainly focused solely on source sentence tokens' attributions. Therefore, we lack a full understanding of the influences of every input token (source sentence and target prefix) in the model predictions. In this work, we propose an interpretability method that tracks input tokens' attributions for both contexts. Our method, which can be extended to any encoder-decoder Transformer-based model, allows us to better comprehend the inner workings of current NMT models. We apply the proposed method to both bilingual and multilingual Transformers and present insights into their behaviour.


title: Evolution of biomedical innovation quantified via billions of distinct article-level MeSH keyword combinations

abstract: We develop a systematic approach to measuring combinatorial innovation in the biomedical sciences based upon the comprehensive ontology of Medical Subject Headings (MeSH). This approach leverages an expert-defined knowledge ontology that features both breadth (27,875 MeSH analyzed across 25 million articles indexed by PubMed from 1902 onwards) and depth (we differentiate between Major and Minor MeSH terms to identify differences in the knowledge network representation constructed from primary research topics only). With this level of uniform resolution we differentiate between three different modes of innovation contributing to the combinatorial knowledge network: (i) conceptual innovation associated with the emergence of new concepts and entities (measured as the entry of new MeSH); and (ii) recombinant innovation, associated with the emergence of new combinations, which itself consists of two types: peripheral (i.e., combinations involving new knowledge) and core (combinations comprised of pre-existing knowledge only). Another relevant question we seek to address is whether examining triplet and quartet combinations, in addition to the more traditional dyadic or pairwise combinations, provide evidence of any new phenomena associated with higher-order combinations. Analysis of the size, growth, and coverage of combinatorial innovation yield results that are largely independent of the combination order, thereby suggesting that the common dyadic approach is sufficient to capture essential phenomena. Our main results are twofold: (a) despite the persistent addition of new MeSH terms, the network is densifying over time meaning that scholars are increasingly exploring and realizing the vast space of all knowledge combinations; and (b) conceptual innovation is increasingly concentrated within single research articles, a harbinger of the recent paradigm shift towards convergence science.


title: The game of Cops and Robber on geodesic spaces

abstract: The game of Cops and Robber is traditionally played on a finite graph. The purpose of this paper is to introduce and analyse the game that is played on an arbitrary geodesic space (a compact, path-connected space endowed with intrinsic metric). It is shown that the game played on metric graphs is essentially the same as the discrete game played on abstract graphs and that for every compact geodesic surface there is an integer $c$ such that $c$ cops can win the game against one robber, and $c$ only depends on the genus $g$ of the surface. It is shown that $c=3$ for orientable surfaces of genus $0$ or $1$ and nonorientable surfaces of crosscap number $1$ or $2$ (with any number of boundary components) and that $c=O(g)$ and that $c=\Omega(\sqrt{g})$ when the genus $g$ is larger. The main motivation for discussing this game is to view the cop number (the minimum number of cops needed to catch the robber) as a new geometric invariant describing how complex is the geodesic space.


title: TransforMatcher: Match-to-Match Attention for Semantic Correspondence

abstract: Establishing correspondences between images remains a challenging task, especially under large appearance changes due to different viewpoints or intra-class variations. In this work, we introduce a strong semantic image matching learner, dubbed TransforMatcher, which builds on the success of transformer networks in vision domains. Unlike existing convolution- or attention-based schemes for correspondence, TransforMatcher performs global match-to-match attention for precise match localization and dynamic refinement. To handle a large number of matches in a dense correlation map, we develop a light-weight attention architecture to consider the global match-to-match interactions. We also propose to utilize a multi-channel correlation map for refinement, treating the multi-level scores as features instead of a single score to fully exploit the richer layer-wise semantics. In experiments, TransforMatcher sets a new state of the art on SPair-71k while performing on par with existing SOTA methods on the PF-PASCAL dataset.


title: A Role for the Fauxrizon in the Semiclassical Limit of a Fuzzball

abstract: Recent work on the status of astrophysical modeling in the wake of quantum gravity indicates that a 'fauxrizon' (portmanteau of 'faux horizon'), such as is relevant to understanding astrophysical black holes according to the fuzzball proposal within string theory, might ultimately solve the familiar black hole evaporation paradox. I clarify, with general upshots for the foundations of quantum gravity research, some of what this suggestion would amount to: identification of intertheoretic constraints on global spacetime structure in (observer-relative) semiclassical models of fuzzballs.


title: Forecasting of Non-Stationary Sales Time Series Using Deep Learning

abstract: The paper describes the deep learning approach for forecasting non-stationary time series with using time trend correction in a neural network model. Along with the layers for predicting sales values, the neural network model includes a subnetwork block for the prediction weight for a time trend term which is added to a predicted sales value. The time trend term is considered as a product of the predicted weight value and normalized time value. The results show that the forecasting accuracy can be essentially improved for non-stationary sales with time trends using the trend correction block in the deep learning model.


title: Optimal embedded and enclosing isosceles triangles

abstract: Given a triangle $\Delta$, we study the problem of determining the smallest enclosing and largest embedded isosceles triangles of $\Delta$ with respect to area and perimeter. This problem was initially posed by Nandakumar and was first studied by Kiss, Pach, and Somlai, who showed that if $\Delta'$ is the smallest area isosceles triangle containing $\Delta$, then $\Delta'$ and $\Delta$ share a side and an angle. In the present paper, we prove that for any triangle $\Delta$, every maximum area isosceles triangle embedded in $\Delta$ and every maximum perimeter isosceles triangle embedded in $\Delta$ shares a side and an angle with $\Delta$. Somewhat surprisingly, the case of minimum perimeter enclosing triangles is different: there are infinite families of triangles $\Delta$ whose minimum perimeter isosceles containers do not share a side and an angle with $\Delta$.


title: DOGE-Train: Discrete Optimization on GPU with End-to-end Training

abstract: We present a fast, scalable, data-driven approach for solving relaxations of 0-1 integer linear programs. We use a combination of graph neural networks (GNN) and the Lagrange decomposition based algorithm FastDOG (Abbas and Swoboda 2022b). We make the latter differentiable for end-to-end training and use GNNs to predict its algorithmic parameters. This allows to retain the algorithm's theoretical properties including dual feasibility and guaranteed non-decrease in the lower bound while improving it via training. We overcome suboptimal fixed points of the basic solver by additional non-parametric GNN update steps maintaining dual feasibility. For training we use an unsupervised loss. We train on smaller problems and test on larger ones showing strong generalization performance with a GNN comprising only around $10k$ parameters. Our solver achieves significantly faster performance and better dual objectives than its non-learned version, achieving close to optimal objective values of LP relaxations of very large structured prediction problems and on selected combinatorial ones. In particular, we achieve better objective values than specialized approximate solvers for specific problem classes while retaining their efficiency. Our solver has better any-time performance over a large time period compared to a commercial solver. Code available at https://github.com/LPMP/BDD


title: Generic Naked Singularities in Vaidya Spacetimes

abstract: We investigate the occurrence of naked singularities, local and global, in the incoming Vaidya spacetimes with zero initial mass. While it is well-known that these spacetimes admit locally and globally naked singularities, we demonstrate that globally naked singularities are significantly more common than is stressed in the literature, being generic in a natural topology on this collection of spacetimes. A heuristic consequence of the results is that the slow accumulation of mass is both necessary and sufficient for both types of naked singularities in these spacetimes. We demonstrate that the naked singularity, as long as it exists, always has divergent curvature (Kretschmann scalar) associated to it along emerging null curves, regardless of the form of the mass function. In particular, a consequence is that the curvature strength of the singularity cannot be smoothed away.


title: Generalization Gap in Amortized Inference

abstract: The ability of likelihood-based probabilistic models to generalize to unseen data is central to many machine learning applications such as lossless compression. In this work, we study the generalization of a popular class of probabilistic model - the Variational Auto-Encoder (VAE). We discuss the two generalization gaps that affect VAEs and show that overfitting is usually dominated by amortized inference. Based on this observation, we propose a new training objective that improves the generalization of amortized inference. We demonstrate how our method can improve performance in the context of image modeling and lossless compression.


title: Machine Learning for Electricity Market Clearing

abstract: This paper seeks to design a machine learning twin of the optimal power flow (OPF) optimization, which is used in market-clearing procedures by wholesale electricity markets. The motivation for the proposed approach stems from the need to obtain the digital twin, which is much faster than the original, while also being sufficiently accurate and producing consistent generation dispatches and locational marginal prices (LMPs), which are primal and dual solutions of the OPF optimization, respectively. Availability of market-clearing tools based on this approach will enable computationally tractable evaluation of multiple dispatch scenarios under a given unit commitment. Rather than direct solution of OPF, the Karush-Kuhn-Tucker (KKT) conditions for the OPF problem in question may be written, and in parallel the LMPs of generators and loads may be expressed in terms of the OPF Lagrangian multipliers. Also, taking advantage of the practical fact that many of the Lagrangian multipliers associated with lines will be zero (thermal limits are not binding), we build and train an ML scheme which maps flexible resources (loads and renewables) to the binding lines, and supplement it with an efficient power-grid aware linear map to optimal dispatch and LMPs. The scheme is validated and illustrated on IEEE models. We also report a trade of analysis between quality of the reconstruction and number of samples needed to train the model.


title: Riemannian Penrose inequality via Nonlinear Potential Theory

abstract: We provide a new proof of the Riemannian Penrose inequality for time-symmetric asymptotically flat initial data with a single black-hole horizon. The proof proceeds through a newly established monotonicity formula holding along the level sets of the $p$-capacitary potential of the horizon boundary, in any asymptotically flat $3$-manifold with nonnegative scalar curvature.


title: Tightness for branching random walk in time-inhomogeneous random environment

abstract: We consider a branching random walk in time-inhomogeneous random environment, in which all particles at generation $k$ branch into the same random number of particles $\mathcal{L}_{k+1}\ge 2$, where the $\mathcal{L}_k$, $k\in\mathbb{N}$, are i.i.d., and the increments are standard normal. Let $\mathbb{P}$ denote the law of $(\mathcal{L}_k)_{k\in\mathbb{N}}$, and let $M_n$ denote the position of the maximal particle in generation $n$. We prove that there are $m_n$, which are functions of only $(\mathcal{L}_k)_{k\in\{0,\dots, n\}}$, such that (with regard to $\mathbb{P}$) the sequence $(M_n-m_n)_{n\in\mathbb{N}}$ is tight with high probability.


title: Visual and unplugged coding lessons with smart toys

abstract: Our Computer science k-12 education research group and the educational toy company Quercetti have been collaborating together to design and manufacture toys that help stimulate and consolidate so-called computational thinking. This approach is inspired by methods already consolidated in the literature and widespread worldwide such as the Bebras tasks and CS-Unplugged. This paper describes two smart toys, their design process, educational activities that can be proposed by teachers exploiting the two toys, the evaluation's results from some teachers, and finally feedback and reviews from buyers. The main activities proposed by these toys leverage visual coding through small colored physical items (e.g., pegs and balls) to deliver the unplugged activities to young users.


title: The star-formation rates of QSOs

abstract: We examine the far-IR properties of a sample of 5391 optically selected QSOs in the 0.5<z<2.65 redshift range down to log[nuLnu,2500 (erg/s)]>44.7, using SPIRE data from Herschel-ATLAS. We split the sample in a grid of 74 luminosity-redshift bins and compute the average optical-infrared spectral energy distribution (SED) in each bin. By normalising an intrinsic AGN template to the AGN optical power (at 5100A) we decompose the total infrared emission (L_IR; 8-1000um) into an AGN (L_IR,AGN) and star-forming component (L_IR,SF). We find that the AGN contribution to L_IR increases as a function of AGN power which manifests as a reduction of the `far-IR bump' in the average QSO SEDs. We note that L_IR,SF does not correlate with AGN power; the mean star formation rates (SFRs) of AGN host galaxies are a function of redshift only and they range from ~6 Msun/yr at z~0 to a plateau of <200 Msun/yr at z~2.6. Our results indicate that the accuracy of far-IR emission as a proxy for SFR decreases with increasing AGN luminosity. We show that, at any given redshift, observed trends between infrared luminosity (whether monochromatic or total) and AGN power (in the optical or X-rays) can be explained by a simple model which is the sum of two components: (A) the infrared emission from star-formation, uncorrelated with AGN power and (B) the infrared emission from AGN, directly proportional to AGN power in the optical or X-rays.


title: A hybrid approach to basis set independent Poisson solver for an arbitrary charge distribution

abstract: We review two common numerical schemes for Coulomb potential evaluation that differ only in their radial part of the solutions in the spherical harmonic expansion (SHE). One is based on finite-difference method (FDM) while the other is based on the Green's function (GF) solution to the radial part of the Poisson equation. We analyze the methods and observe that the FDM-based approach appears to be more efficient in terms of the convergence with the number of radial points, particularly for monopole (l=0). However, as a known issue, it suffers from error accumulation as the system size increases. We identify the source of error that comes mainly from l=1 (and sometimes l=2) contribution of SHE induced by the charge partitioning. We then propose a hybrid scheme by combining the two methods, where the radial solution for l=0 is obtained using the FDM method and treating the remaining terms using GF approach. The proposed hybrid method is subsequently applied to a variety of systems to examine its performance. The results show improved accuracy than earlier numerical schemes in all cases. We also show that, even with a generic set of radial grid parameters, accurate energy differences can be obtained using a numerical Coulomb solver in standard density functional studies. ~


title: Energy Landscape Design Principle for Optimal Energy Harnessing by Catalytic Molecular Machines

abstract: Under temperature oscillation, cyclic molecular machines such as catalysts and enzymes could harness energy from the oscillatory bath and use it to drive other processes. Using a novel geometrical approach, under fast temperature oscillation, we derive a general design principle for obtaining the optimal catalytic energy landscape that can harness energy from a temperature-oscillatory bath and use it to invert a spontaneous reaction. By driving the reaction against the spontaneous direction, the catalysts convert low free energy product molecules to high free energy reactant molecules. The design principle, derived for arbitrary cyclic catalysts, is expressed as a simple quadratic objective function that only depends on the reaction activation energies, and is independent of the temperature protocol. Since the reaction activation energies are directly accessible by experimental measurements, the objective function can be directly used to guide the search for optimal energy-harvesting catalysts.


title: Deep Representations for Time-varying Brain Datasets

abstract: Finding an appropriate representation of dynamic activities in the brain is crucial for many downstream applications. Due to its highly dynamic nature, temporally averaged fMRI (functional magnetic resonance imaging) can only provide a narrow view of underlying brain activities. Previous works lack the ability to learn and interpret the latent dynamics in brain architectures. This paper builds an efficient graph neural network model that incorporates both region-mapped fMRI sequences and structural connectivities obtained from DWI (diffusion-weighted imaging) as inputs. We find good representations of the latent brain dynamics through learning sample-level adaptive adjacency matrices and performing a novel multi-resolution inner cluster smoothing. We also attribute inputs with integrated gradients, which enables us to infer (1) highly involved brain connections and subnetworks for each task, (2) temporal keyframes of imaging sequences that characterize tasks, and (3) subnetworks that discriminate between individual subjects. This ability to identify critical subnetworks that characterize signal states across heterogeneous tasks and individuals is of great importance to neuroscience and other scientific domains. Extensive experiments and ablation studies demonstrate our proposed method's superiority and efficiency in spatial-temporal graph signal modeling with insightful interpretations of brain dynamics.


title: A Variational Bayesian Perspective on Massive MIMO Detection

abstract: Optimal data detection in massive multiple-input multiple-output (MIMO) systems requires prohibitive computational complexity. A variety of detection algorithms have been proposed in the literature, offering different trade-offs between complexity and detection performance. In this paper, we build upon variational Bayes (VB) inference to design low-complexity multiuser detection algorithms for massive MIMO systems. We first examine the massive MIMO detection problem with perfect channel state information at the receiver (CSIR) and show that a conventional VB method with known noise variance yields poor detection performance. To address this limitation, we devise two new VB algorithms that use the noise variance and covariance matrix postulated by the algorithms themselves. We further develop the VB framework for massive MIMO detection with imperfect CSIR. Simulation results show that the proposed VB methods achieve significantly lower detection errors compared with existing schemes for a wide range of channel models.


title: Spin Tetrad Formalism Of Circular Polarization States In Relativistic Jets

abstract: Relativistic jets from active galactic nuclei (AGN) have been of peak interest in the high-energy astrophysics community for their uniquely dynamic nature and incredible radiative power; emanating from supermassive black holes and similarly accreting compact dense objects. An overall consensus on relativistic jet formation states that accelerated outflow at high Lorentz factors are generated by a complex relationship between the accretion disk of the system and the frame-dragging effects of the rotating massive central object. This paper will provide a basis for which circular polarization states, defined using a spin tetrad formalism, contribute to a description for the angular momentum flux in the jet emanating from the central engine. A representation of the Kerr spacetime with positive cosmological constant background is used in formulating the spin tetrad forms. A discussion on unresolved problems in jet formation and how we can use multi-method observations with polarimetry of AGN to direct future theoretical descriptions will also be given.


title: A Natural Language Processing Pipeline for Detecting Informal Data References in Academic Literature

abstract: Discovering authoritative links between publications and the datasets that they use can be a labor-intensive process. We introduce a natural language processing pipeline that retrieves and reviews publications for informal references to research datasets, which complements the work of data librarians. We first describe the components of the pipeline and then apply it to expand an authoritative bibliography linking thousands of social science studies to the data-related publications in which they are used. The pipeline increases recall for literature to review for inclusion in data-related collections of publications and makes it possible to detect informal data references at scale. We contribute (1) a novel Named Entity Recognition (NER) model that reliably detects informal data references and (2) a dataset connecting items from social science literature with datasets they reference. Together, these contributions enable future work on data reference, data citation networks, and data reuse.


title: BeeGees: stayin' alive in chained BFT

abstract: Modern chained Byzantine Fault Tolerant (BFT) systems leverage a combination of pipelining and leader rotation to obtain both efficiency and fairness. These protocols, however, require a sequence of three or four consecutive honest leaders to commit operations. Therefore, even simple leader failures such as crashes can weaken liveness both theoretically and practically. Obtaining a chained BFT protocol that reaches decisions even if the sequence of honest leaders is non-consecutive, remains an open question. To resolve this question we present BeeGees, a novel chained BFT protocol that successfully commits blocks even with non-consecutive honest leaders. It does this while also maintaining quadratic word complexity with threshold signatures, linear word complexity with SNARKs, and responsiveness between consecutive honest leaders. BeeGees reduces the expected commit latency of HotStuff by a factor of three under failures, and the worst-case latency by a factor of seven.


title: Schur complement dominant operator matrices

abstract: We propose a method for the spectral analysis of unbounded operator matrices in a general setting which fully abstains from standard perturbative arguments. Rather than requiring the matrix to act in a Hilbert space $\mathcal{H}$, we extend its action to a suitable distributional triple $\mathcal{D} \subset \mathcal{H} \subset \mathcal{D}_-$ and restrict it to its maximal domain in $\mathcal{H}$. The crucial point in our approach is the choice of the spaces $\mathcal{D}$ and $\mathcal{D}_-$ which are essentially determined by the Schur complement of the matrix. We show spectral equivalence between the resulting operator matrix in $\mathcal{H}$ and its Schur complement, which allows to pass from a suitable representation of the Schur complement (e.g. by generalised form methods) to a representation of the operator matrix. We thereby generalise classical spectral equivalence results imposing standard dominance patterns. The abstract results are applied to damped wave equations with possibly unbounded and/or singular damping, to Dirac operators with Coulomb-type potentials, as well as to generic second order matrix differential operators. By means of our methods, previous regularity assumptions can be weakened substantially.


title: Extended random-phase-approximation study of fragmentation of giant quadrupole resonance in $^{16}$O

abstract: The damping of isoscalar giant quadrupole resonance in $^{16}$O is studied using extended random-phase-approximation approaches derived from the time-dependent density-matrix theory. It is pointed out that the effects of ground-state correlations bring strong fragmentation of quadrupole strength even if the number of two particle--two hole configurations is strongly limited.


title: Attitudes, willingness, and resources to cover Article Publishing Charges (APC): the influence of age, position, income level country, discipline and open access habits

abstract: The rise of open access (OA) publishing has been followed by the expansion of the Article Publishing Charges (APC) that moves the financial burden of scholarly journal publishing from readers to authors. We introduce the results of an international randomly selected sampled survey (N=3,422) that explores attitudes towards this pay-to-publish or Gold OA model among scholars. We test the predictor role of age, professional position, discipline, and income-level country in this regard. We found that APCs are perceived more as a global threat to Science than a deterrent to personal professional careers. Academics in low and lower-middle income level countries hold the most unfavorable opinions about the APC system. The less experimental disciplines held more negative perceptions of APC compared to STEM and the Life Sciences. Age and access to external funding stood as negative predictors of refusal to pay to publish. Commitment to OA self-archiving predicted the negative global perception of the APC. We conclude that access to external research funds influences the acceptance and the particular perception of the pay to publish model, remarking the economic dimension of the problem and warning about issues in the inequality between center and periphery.


title: FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid?

abstract: The existence of a plethora of language models makes the problem of selecting the best one for a custom task challenging. Most state-of-the-art methods leverage transformer-based models (e.g., BERT) or their variants. Training such models and exploring their hyperparameter space, however, is computationally expensive. Prior work proposes several neural architecture search (NAS) methods that employ performance predictors (e.g., surrogate models) to address this issue; however, analysis has been limited to homogeneous models that use fixed dimensionality throughout the network. This leads to sub-optimal architectures. To address this limitation, we propose a suite of heterogeneous and flexible models, namely FlexiBERT, that have varied encoder layers with a diverse set of possible operations and different hidden dimensions. For better-posed surrogate modeling in this expanded design space, we propose a new graph-similarity-based embedding scheme. We also propose a novel NAS policy, called BOSHNAS, that leverages this new scheme, Bayesian modeling, and second-order optimization, to quickly train and use a neural surrogate model to converge to the optimal architecture. A comprehensive set of experiments shows that the proposed policy, when applied to the FlexiBERT design space, pushes the performance frontier upwards compared to traditional models. FlexiBERT-Mini, one of our proposed models, has 3% fewer parameters than BERT-Mini and achieves 8.9% higher GLUE score. A FlexiBERT model with equivalent performance as the best homogeneous model achieves 2.6x smaller size. FlexiBERT-Large, another proposed model, achieves state-of-the-art results, outperforming the baseline models by at least 5.7% on the GLUE benchmark.


title: The mod $p$ Riemann-Hilbert correspondence and the perfect site

abstract: The mod $p$ Riemann-Hilbert correspondence (in covariant and contravariant forms) relates $\mathbb{F}_p$-\'etale sheaves on the spectrum of an $\mathbb{F}_p$-algebra $R$ and Frobenius modules over $R$. We give an exposition of these correspondences using Breen's vanishing results on the perfect site.


title: Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions

abstract: Generics express generalizations about the world (e.g., birds can fly) that are not universally true (e.g., newborn birds and penguins cannot fly). Commonsense knowledge bases, used extensively in NLP, encode some generic knowledge but rarely enumerate such exceptions and knowing when a generic statement holds or does not hold true is crucial for developing a comprehensive understanding of generics. We present a novel framework informed by linguistic theory to generate exemplars -- specific cases when a generic holds true or false. We generate ~19k exemplars for ~650 generics and show that our framework outperforms a strong GPT-3 baseline by 12.8 precision points. Our analysis highlights the importance of linguistic theory-based controllability for generating exemplars, the insufficiency of knowledge bases as a source of exemplars, and the challenges exemplars pose for the task of natural language inference.


title: Fast GPU bounding boxes on tree-structured scenes

abstract: Computation of bounding boxes is a fundamental problem in high performance rendering, as it is an input to visibility culling and binning operations. In a scene description structured as a tree, clip nodes and blend nodes entail intersection and union of bounding boxes, respectively. These are straightforward to compute on the CPU using a sequential algorithm, but an efficient, parallel GPU algorithm is more elusive. This paper presents a fast and practical solution, with a new algorithm for the classic parentheses matching problem at its core. The core algorithm is presented abstractly (in terms of a PRAM abstraction), then with a concrete mapping to the thread, workgroup, and dispatch levels of real GPU hardware. The algorithm is implemented portably using compute shaders, and performance results show a dramatic speedup over a sequential CPU version, and indeed a reasonable fraction of maximum theoretical throughput of the GPU hardware. The immediate motivating application is 2D rendering, but the algorithms generalize to other domains, and the core parentheses matching problem has other applications including parsing.


title: A Taxonomy of Schema Changes for NoSQL Databases

abstract: Schema evolution is a crucial aspect in database management. The proposed taxonomies of schema changes have neglected the set of operations that involves relationships between entity types: aggregation and references, as well as the possible existence of structural variations for schema types, as most of NoSQL systems are schemaless. The distinction between entity types and relationship types, which is typical of graph schemas, is also not taken into account in the published works. Moreover, NoSQL schema evolution poses the challenge of having different data models, and no standard specification exists for them. In this paper, a generic approach for evolving NoSQL and relational schemas is presented, which is based on the U-Schema unified data model that includes aggregation and reference relationships, and structural variations. For this data model, we introduce a taxonomy of schema changes for all the U-Schema elements, which is implemented by creating the Orion database-independent language. We will show how Orion can be used to automatically generate evolution scripts for a set of NoSQL databases, and the feasibility of each schema operation will be analyzed through the performance results obtained. The taxonomy has been formally validated by means of Alloy, and two case studies show the application of Orion.


title: On an obstacle to the converse of Dahlberg's theorem in high codimensions

abstract: It has been recently understood that the harmonic measure on the boundary $E = \partial \Omega$ of a domain $\Omega$ in $\mathbb{R}^n$ is absolutely continuous with respect to the Hausdorff measure $\mathcal{H}^{n - 1}$ on $E$ if and only if the boundary $E$ is rectifiable. Then, by G. David, M. Engelstein, J. Feneuil, S. Mayboroda and other coauthors, a notion of harmonic measure for Ahlfors-regular sets $E$ of higher codimension $n - d$ was developed with the aid of the operator $L_\alpha = -\mbox{div} D_{\alpha}^{-n + d + \alpha} \nabla$, where $\alpha > 0$ and $D_\alpha$ is a certain regularized distance function to the set $E$. A program was launched to establish analogous to the classical case equivalence between rectifiability of the higher-codimensional set $E$ and good relations of the (new) harmonic and Hausdorff measures. The sufficiency of rectifiability for quantitative absolute continuity was only just obtained. For the other direction the main obstacle is to prove that, roughly, the equation $L_\alpha D_\alpha = 0$ is true only when the set $E$ is a hyperplane. In this paper we prove some first results which indicate that the latter conjecture may be true. We also explain that a certain natural strategy to tackle the problem does not work till the end.


title: Structure of solutions of exponential equations in acylindrically hyperbolic groups

abstract: Let $G$ be a group acting acylindrically on a hyperbolic space and let $E$ be an exponential equation over $G$. We show that $E$ is equivalent to a finite disjunction of finite systems of pairwise independent equations which are either loxodromic over virtually cyclic subgroups or elliptic. We also obtain a description of the solution set of $E$. We obtain stronger results in the case where $G$ is hyperbolic relative to a collection of peripheral subgroups $\{H_{\lambda}\}_{\lambda\in \Lambda}$. In particular, we prove in this case that the solution sets of exponential equations over $G$ are $\mathbb{Z}$-semilinear if and only if the solution sets of exponential equations over every $H_{\lambda}$, $\lambda\in \Lambda$, are $\mathbb{Z}$-semilinear. We obtain an analogous result for finite disjunctions of finite systems of exponential equations and inequations over relatively hyperbolic groups in terms of definable sets in the weak Presburger arithmetic.


title: The MD17 Datasets from the Perspective of Datasets for Gas-Phase "Small" Molecule Potentials

abstract: There has been great progress in developing methods for machine-learned potential energy surfaces. There have also been important assessments of these methods by comparing so-called learning curves on datasets of electronic energies and forces, notably the MD17 database. The dataset for each molecule in this database generally consists of tens of thousands of energies and forces obtained from DFT direct dynamics at 500 K. We contrast the datasets from this database for three "small" molecules, ethanol, malonaldehyde, and glycine, with datasets we have generated with specific targets for the PESs in mind: a rigorous calculation of the zero-point energy and wavefunction, the tunneling splitting in malonaldehyde and in the case of glycine a description of all eight low-lying conformers. We found that the MD17 datasets are too limited for these targets. We also examine recent datasets for several PESs that describe small-molecule but complex chemical reactions. Finally, we introduce a new database, "QM-22", which contains datasets of molecules ranging from 4 to 15 atoms that extend to high energies and a large span of configurations.


title: Towards Model Generalization for Monocular 3D Object Detection

abstract: Monocular 3D object detection (Mono3D) has achieved tremendous improvements with emerging large-scale autonomous driving datasets and the rapid development of deep learning techniques. However, caused by severe domain gaps (e.g., the field of view (FOV), pixel size, and object size among datasets), Mono3D detectors have difficulty in generalization, leading to drastic performance degradation on unseen domains. To solve these issues, we combine the position-invariant transform and multi-scale training with the pixel-size depth strategy to construct an effective unified camera-generalized paradigm (CGP). It fully considers discrepancies in the FOV and pixel size of images captured by different cameras. Moreover, we further investigate the obstacle in quantitative metrics when cross-dataset inference through an exhaustive systematic study. We discern that the size bias of prediction leads to a colossal failure. Hence, we propose the 2D-3D geometry-consistent object scaling strategy (GCOS) to bridge the gap via an instance-level augment. Our method called DGMono3D achieves remarkable performance on all evaluated datasets and surpasses the SoTA unsupervised domain adaptation scheme even without utilizing data on the target domain.


title: The laws of thermodynamics for quantum dissipative systems: A quasi-equilibrium Helmholtz energy approach

abstract: Using the quasi-equilibrium Helmholtz energy (qHE), defined as the thermodynamic work in a quasi-static process, we investigate the thermal properties of both an isothermal process and a transition process between the adiabatic and isothermal states (adiabatic transition). Here, the work is defined by the change in energy from a steady-state to another state under a time-dependent perturbation. In particular, the work for a quasi-static change is regarded as thermodynamic work. We employ a system--bath model that involves time-dependent perturbations in both the system and the system--bath interaction. We conduct numerical experiments for a three-stroke heat machine (a Kelvin-Planck cycle). For this purpose, we employ the hierarchical equations of motion (HEOM) approach. These experiments involve an adiabatic transition field that describes the operation of an adiabatic wall between the system and the bath. Thermodynamic--work diagrams for external fields and their conjugate variables, similar to the $P$--$V$ diagram, are introduced to analyze the work done for the system in the cycle. We find that the thermodynamic efficiency of this machine is zero because the field for the isothermal processes acts as a refrigerator, whereas that for the adiabatic wall acts as a heat engine. This is a numerical manifestation of the Kelvin--Planck statement, which states that it is impossible to derive mechanical effects from a single heat source. These HEOM simulations serve as a rigorous test of thermodynamic formulations because the second law of thermodynamics is only valid when the work involved in the operation of the adiabatic wall is treated accurately.


title: Algorithm Development for Controlling Movement of a Robotic Platform by Digital Image Processing

abstract: The following work shows an algorithm that can process images digitally with the goal of control the movement of a mobile robotic platform in a certain environment. The platform is identified with a specific color, and displacement environment of the platform shift has identified obstacles with different colors, for both cases it worked with the RGB color scale. To obtain the control's movement of the robotic platform, the algorithm was developed in C programming language, and used the Open CV libraries for processing images captured by a video camera on the Dev-platform C + +. The video camera was previously calibrated using ZHANG technique where parameters were obtained focal length and tilt focal pixel. In the algorithm histogram analysis and segmentation of the image were developed, allowing to determine exactly the relative position of the platform with respect to the obstacles and movement strategy to follow.


title: Connectivity conditions and boundary Poincar\'e inequalities

abstract: Inspired by recent work of Mourgoglou and the second named author, and earlier work of Hofmann, Mitrea and Taylor, we consider connections between the local John condition, the Harnack chain condition and weak boundary Poincar\'e inequalities in open sets $\Omega \subset \mathbb{R}^{n+1}$, with codimension $1$ Ahlfors--David regular boundaries. First, we prove that if $\Omega$ satisfies both the local John condition and the exterior corkscrew condition, then $\Omega$ also satisfies the Harnack chain condition (and hence, is a chord-arc domain). Second, we show that if $\Omega$ is a $2$-sided chord-arc domain, then the boundary $\partial \Omega$ supports a Heinonen--Koskela type weak $1$-Poincar\'e inequality. We also construct an example of a set $\Omega \subset \mathbb{R}^{n+1}$ such that the boundary $\partial \Omega$ is Ahlfors--David regular and supports a weak boundary $1$-Poincar\'e inequality but $\Omega$ is not a chord-arc domain. Our proofs utilize significant advances in particularly harmonic measure, uniform rectifiability and metric Poincar\'e theories.


title: TIC como apoyo del soporte social al enfermo cr\'onico y su cuidador : Aproximaci\'on al estado del Arte

abstract: The current approach is carried out in order to have an overview of the level of inclusion and the participation of ICTs in social support and support for vulnerable populations suffering from chronic diseases. The inclusion was made through a bibliographic review, this being the basis for the collection of data and pertinent information. The argumentative study that was carried out clearly and concisely identified the advantages and disadvantages of the use of ICT in social support from a psychoeducational and engineering point of view. The regions were characterized by the highest concentration of ICT use in the social support literature, based on previously studied content and analyzing the results of this use.


title: Spin Hall effect driven by the spin magnetic moment current in Dirac materials

abstract: The spin Hall effect of a Dirac Hamiltonian system is studied using semiclassical analyses and the Kubo formula. In this system, the spin Hall conductivity is dependent on the definition of spin current. All components of the spin Hall conductivity vanish when spin current is defined as the flow of spin angular momentum. In contrast, the off-diagonal components of the spin Hall conductivity are non-zero and scale with the carrier velocity (and the effective $g$-factor) when spin current consists of the flow of spin magnetic moment. We derive analytical formula of the conductivity, carrier mobility and the spin Hall conductivity to compare with experiments. In experiments, we use Bi as a model system that can be characterized by the Dirac Hamiltonian. Te and Sn are doped into Bi to vary the electron and hole concentration, respectively. We find the spin Hall conductivity ($\sigma_\mathrm{SH}$) takes a maximum near the Dirac point and decreases with increasing carrier density ($n$). The sign of $\sigma_\mathrm{SH}$ is the same regardless of the majority carrier type. The spin Hall mobility, proportional to $\sigma_\mathrm{SH}/n$, increases with increasing carrier mobility with a scaling coefficient of $\sim$1.4. These features can be accounted for quantitatively using the derived analytical formula. The results demonstrate that the giant spin magnetic moment, with an effective $g$-factor that approaches 100, is responsible for the spin Hall effect in Bi.


title: Knot concordance invariants from Seiberg-Witten theory and slice genus bounds in 4-manifolds

abstract: We construct a new family of knot concordance invariants $\theta^{(q)}(K)$, where $q$ is a prime number. Our invariants are obtained from the equivariant Seiberg-Witten-Floer cohomology, constructed by the author and Hekmati, applied to the degree $q$ cyclic cover of $S^3$ branched over $K$. In the case $q=2$, our invariant $\theta^{(2)}(K)$ shares many similarities with the knot Floer homology invariant $\nu^+(K)$ defined by Hom and Wu. Our invariants $\theta^{(q)}(K)$ give lower bounds on the genus of any smooth, properly embedded, homologically trivial surface bounding $K$ in a definite $4$-manifold with boundary $S^3$.


title: On the initial value problem for semiclassical gravity without and with quantum state collapses

abstract: We explore how the initial value problem may be formulated for globally hyperbolic, Hadamard, solutions of the semiclassical Einstein-Klein-Gordon equations. Given a set of data on an initial 3-surface, consisting of the values on the surface of a spacetime metric and its first 3 time derivatives off the surface, we introduce a notion of 'surface Hadamard' state on the CCR algebra of the surface. We conjecture that, for a given such set of classical Cauchy data with a surface Hadamard state satisfying the semiclassical constraint equations, the initial value problem will be well posed. We present similar conjectures for a semiclassical scalars model and semiclassical electrodynamics. Moreover, partly inspired by work of Parker and Simon in 1993, we define semiclassical gravity `physical solutions' to be those that are (jointly smooth) functions of $\hbar$ and of coordinates continuous in $\hbar$ at $\hbar =0$. We conjecture that for such solutions the second and third time derivatives of the metric off the surface need not be specified, but rather will be determined by that continuity condition. Assuming the initial value conjecture for such physical solutions holds, and that a stochastic rule were available which leads to quantum state collapses occurring on (non-intersecting) random Cauchy surfaces, we discuss the well-posedness of semiclassical gravity with stochastic quantum state collapses. We also discuss two notions of approximate physical semiclassical solutions (both with and without collapses): Namely solutions to order $\hbar$ (first discussed by Parker and Simon in 1993) and solutions to order $\hbar^0$. We point out that the latter do not require higher derivative terms or Hadamard subtractions, but that nevertheless order $\hbar^0$ semiclassical gravity is a distinct theory from classical general relativity capable of incorporating quantum interference phenomena.


title: Why does Throwing Away Data Improve Worst-Group Error?

abstract: When facing data with imbalanced classes or groups, practitioners follow an intriguing strategy to achieve best results. They throw away examples until the classes or groups are balanced in size, and then perform empirical risk minimization on the reduced training set. This opposes common wisdom in learning theory, where the expected error is supposed to decrease as the dataset grows in size. In this work, we leverage extreme value theory to address this apparent contradiction. Our results show that the tails of the data distribution play an important role in determining the worst-group-accuracy of linear classifiers. When learning on data with heavy tails, throwing away data restores the geometric symmetry of the resulting classifier, and therefore improves its worst-group generalization.


title: PCA-Boosted Autoencoders for Nonlinear Dimensionality Reduction in Low Data Regimes

abstract: Autoencoders (AE) provide a useful method for nonlinear dimensionality reduction but are ill-suited for low data regimes. Conversely, Principal Component Analysis (PCA) is data-efficient but is limited to linear dimensionality reduction, posing a problem when data exhibits inherent nonlinearity. This presents a challenge in various scientific and engineering domains such as the nanophotonic component design, where data exhibits nonlinear features while being expensive to obtain due to costly real measurements or resource-consuming solutions of partial differential equations. To address this difficulty, we propose a technique that harnesses the best of both worlds: an autoencoder that leverages PCA to perform well on scarce nonlinear data. Specifically, we outline a numerically robust PCA-based initialization of AE, which, together with the parameterized ReLU activation function, allows the training process to start from an exact PCA solution and improve upon it. A synthetic example is presented first to study the effects of data nonlinearity and size on the performance of the proposed method. We then evaluate our method on several nanophotonic component design problems where obtaining useful data is expensive. To demonstrate universality, we also apply it to tasks in other scientific domains: a benchmark breast cancer dataset and a gene expression dataset. We show that our proposed approach is substantially better than both PCA and randomly initialized AE in the majority of low-data regime cases we consider, or at least is comparable to the best of either of the other two methods.


title: On Countably $\alpha$-Compact Topological Spaces

abstract: In this paper, some features of countably $\alpha$-compact topological spaces are presented and proven. The connection between countably $\alpha$% -compact, Tychonoff, and $\alpha$-Hausdorff spaces is explained. The space is countably $\alpha$-compact space iff every locally finite family of non-empty subsets of such space is finite is demonstrated. The countably $% \alpha$-compact space with weight greater than or equal to $\aleph_0$ is the $\alpha$-continuous image of a closed subspace of the cube $D^{\aleph_0}$ is discussed. The boundedness of $\alpha$-continuous functions mapping $\alpha$% -compact spaces to other spaces is cleared. Moreover, the $\alpha$% -continuous function mapping the space $X$ to the countably $\alpha$-compact space $Y$ is an $\alpha$-closed subset of $X\times Y$ is argued and proved. We explained that the $\alpha$-continuous functions mapping any topological space to a countably $\alpha$-compact space can be extended over its domain under some constraints. We claimed that the property of being $\alpha$% -compact is countably $\alpha$-compact but the converse is not and the countable union of countably $\alpha$-compact subspaces of $X$ is also countably $\alpha$-compact.


title: Controlling rheology via boundary conditions in dense granular flows

abstract: Boundary shape, particularly roughness, strongly controls the amount of wall slip in dense granular flows. In this paper, we aim to quantify and understand which aspects of a dense granular flow are controlled by the boundary condition, and to incorporate these observations into a cooperative nonlocal model characterizing slow granular flows. To examine the influence of boundary properties, we perform experiments on a quasi-2D annular shear cell with a rotating inner wall and a fixed outer wall; the later is selected from among 6 walls with various roughness, local concavity, and compliance. We find that we can successfully capture the full flow profile using a single set of empirically determined model parameters, with only the wall slip velocity set by direct observation. Through the use of photoelastic particles, we observe how the internal stresses fluctuate more for rougher boundaries, corresponding to lower wall slip, and connect this observation to the propagation of nonlocal effects originating at the wall.


title: Learning multi-scale functional representations of proteins from single-cell microscopy data

abstract: Protein function is inherently linked to its localization within the cell, and fluorescent microscopy data is an indispensable resource for learning representations of proteins. Despite major developments in molecular representation learning, extracting functional information from biological images remains a non-trivial computational task. Current state-of-the-art approaches use autoencoder models to learn high-quality features by reconstructing images. However, such methods are prone to capturing noise and imaging artifacts. In this work, we revisit deep learning models used for classifying major subcellular localizations, and evaluate representations extracted from their final layers. We show that simple convolutional networks trained on localization classification can learn protein representations that encapsulate diverse functional information, and significantly outperform autoencoder-based models. We also propose a robust evaluation strategy to assess quality of protein representations across different scales of biological function.


title: Semi-Supervised Clustering of Sparse Graphs: Crossing the Information-Theoretic Threshold

abstract: The stochastic block model is a canonical random graph model for clustering and community detection on network-structured data. Decades of extensive study on the problem have established many profound results, among which the phase transition at the Kesten-Stigum threshold is particularly interesting both from a mathematical and an applied standpoint. It states that no estimator based on the network topology can perform substantially better than chance on sparse graphs if the model parameter is below a certain threshold. Nevertheless, if we slightly extend the horizon to the ubiquitous semi-supervised setting, such a fundamental limitation will disappear completely. We prove that with an arbitrary fraction of the labels revealed, the detection problem is feasible throughout the parameter domain. Moreover, we introduce two efficient algorithms, one combinatorial and one based on optimization, to integrate label information with graph structures. Our work brings a new perspective to the stochastic model of networks and semidefinite program research.


title: Compressing Deep Graph Neural Networks via Adversarial Knowledge Distillation

abstract: Deep graph neural networks (GNNs) have been shown to be expressive for modeling graph-structured data. Nevertheless, the over-stacked architecture of deep graph models makes it difficult to deploy and rapidly test on mobile or embedded systems. To compress over-stacked GNNs, knowledge distillation via a teacher-student architecture turns out to be an effective technique, where the key step is to measure the discrepancy between teacher and student networks with predefined distance functions. However, using the same distance for graphs of various structures may be unfit, and the optimal distance formulation is hard to determine. To tackle these problems, we propose a novel Adversarial Knowledge Distillation framework for graph models named GraphAKD, which adversarially trains a discriminator and a generator to adaptively detect and decrease the discrepancy. Specifically, noticing that the well-captured inter-node and inter-class correlations favor the success of deep GNNs, we propose to criticize the inherited knowledge from node-level and class-level views with a trainable discriminator. The discriminator distinguishes between teacher knowledge and what the student inherits, while the student GNN works as a generator and aims to fool the discriminator. To our best knowledge, GraphAKD is the first to introduce adversarial training to knowledge distillation in graph domains. Experiments on node-level and graph-level classification benchmarks demonstrate that GraphAKD improves the student performance by a large margin. The results imply that GraphAKD can precisely transfer knowledge from a complicated teacher GNN to a compact student GNN.


title: Polarimetric detection of nonradial oscillation modes in the beta Cephei star beta Crucis

abstract: Here we report the detection of polarization variations due to nonradial modes in the beta Cephei star beta Crucis. In so doing we confirm 40-year-old predictions of pulsation-induced polarization variability and its utility in asteroseismology for mode identification. In an approach suited to other beta Cep stars, we combine polarimetry with space-based photometry and archival spectroscopy to identify the dominant nonradial mode in polarimetry, f2, as l = 3, m = -3 (in the m-convention of Dziembowski) and determine the stellar axis position angle as 25 (or 205) +/- 8 deg. The rotation axis inclination to the line of sight was derived as approx. 46 deg. from combined polarimetry and spectroscopy, facilitating identification of additional modes and allowing for asteroseismic modelling. This reveals a star of 14.5 +/- 0.5 Solar masses and a convective core containing approx. 28% of its mass -- making beta Crucis the most massive star with an asteroseismic age.


title: HiPAL: A Deep Framework for Physician Burnout Prediction Using Activity Logs in Electronic Health Records

abstract: Burnout is a significant public health concern affecting nearly half of the healthcare workforce. This paper presents the first end-to-end deep learning framework for predicting physician burnout based on electronic health record (EHR) activity logs, digital traces of physician work activities that are available in any EHR system. In contrast to prior approaches that exclusively relied on surveys for burnout measurement, our framework directly learns deep representations of physician behaviors from large-scale clinician activity logs to predict burnout. We propose the Hierarchical burnout Prediction based on Activity Logs (HiPAL), featuring a pre-trained time-dependent activity embedding mechanism tailored for activity logs and a hierarchical predictive model, which mirrors the natural hierarchical structure of clinician activity logs and captures physicians' evolving burnout risk at both short-term and long-term levels. To utilize the large amount of unlabeled activity logs, we propose a semi-supervised framework that learns to transfer knowledge extracted from unlabeled clinician activities to the HiPAL-based prediction model. The experiment on over 15 million clinician activity logs collected from the EHR at a large academic medical center demonstrates the advantages of our proposed framework in predictive performance of physician burnout and training efficiency over state-of-the-art approaches.


title: Integral $F(R)$ Gravity and Saddle Point Condition as a Remedy for the $H_0$-tension

abstract: In this work, we shall provide an $F(R)$ gravity theoretical framework for solving the $H_0$-tension. Specifically, by exploiting the $F(R)$ gravity correspondence with a scalar-tensor theory, we shall provide a condition in which when it is satisfied, the $H_0$-tension is alleviated. The condition that remedies the $H_0$-tension restricts the corresponding $F(R)$ gravity, and we present in brief the theoretical features of the constrained $F(R)$ gravity theory in both the Jordan and Einstein frames. The condition that may remedy the $H_0$-tension is based on the existence of a metastable de Sitter point that occurs for redshifts near the recombination. This metastable de Sitter vacuum restricts the functional form of the $F(R)$ gravity in the Jordan frame. We also show that by appropriately choosing the $F(R)$ gravity, along with the theoretical solution offered for the $H_0$-tension problem, one may also provide a unified description of the inflationary era with the late-time accelerating era, in terms of two extra de Sitter vacua. We propose a new approach to $F(R)$ gravity by introducing a new class of integral $F(R)$ gravity functions, which may be wider than the usual class expressed in terms of elementary $F(R)$ gravity functions. Finally, the Einstein frame inflationary dynamics formalism is briefly discussed.


title: Toward a Unified Explanation for the Three-part Structure of Solar Coronal Mass Ejections

abstract: Coronal mass ejections (CMEs) are associated with the eruption of magnetic flux ropes (MFRs), which usually appear as hot channels in active regions and coronal cavities in quiet-Sun regions. CMEs often exhibit the classical three-part structure in the lower corona when imaged with white-light coronagraphs, including the bright front, dark cavity, and bright core. The bright core and dark cavity have been regarded as the erupted prominence and MFR, respectively, for several decades. However, recent studies clearly demonstrated that both the prominence and hot-channel MFR can be observed as the CME core. The current research presents a three-part CME resulted from the eruption of a coronal prominence cavity on 2010 October 7 with observations from two vantage perspectives, i.e., edge-on from the Earth and face-on from the Solar Terrestrial Relations Observatory (STEREO). Our observations illustrates two important results: (1) For the first time, the erupting coronal cavity is recorded as a channel-like structure in the extreme-ultraviolet passband, analogous to the hot-channel morphology, and is dubbed as warm channel; (2) Both the prominence and warm-channel MFR (coronal cavity) in the extreme-ultraviolet passbands evolve into the CME core in the white-light coronagraphs of STEREO-A. The results support that we are walking toward a unified explanation for the three-part structure of CMEs, in which both prominences and MFRs (hot or warm channels) are responsible for the bright core.


title: Effective Field Theory Analysis of CDMSlite Run 2 Data

abstract: CDMSlite Run 2 was a search for weakly interacting massive particles (WIMPs) with a cryogenic 600 g Ge detector operated in a high-voltage mode to optimize sensitivity to WIMPs of relatively low mass from 2 - 20 GeV/$c^2$. In this article, we present an effective field theory (EFT) analysis of the CDMSlite Run 2 data using an extended energy range and a comprehensive treatment of the expected background. A binned likelihood Bayesian analysis was performed on the recoil energy data, taking into account the parameters of the EFT interactions and optimizing the data selection with respect to the dominant background components. Energy regions within 5$\sigma$ of known activation peaks were removed from the analysis. The Bayesian evidences resulting from the different operator hypotheses show that the CDMSlite Run 2 data are consistent with the background-only models and do not allow for a signal interpretation assuming any additional EFT interaction. Consequently, upper limits on the WIMP mass and coupling-coefficient amplitudes and phases are presented for each EFT operator. These limits improve previous CDMSlite Run 2 bounds for WIMP masses above 5 GeV/$c^2$.


title: Desirable Rankings: A New Method for Ranking Outcomes of a Competitive Process

abstract: We consider the problem of aggregating individual preferences over alternatives into a social ranking. A key feature of the problems that we consider - and the one that allows us to obtain positive results, in contrast to negative results such as Arrow's Impossibililty Theorem - is that the alternatives to be ranked are outcomes of a competitive process. Examples include rankings of colleges or academic journals. The foundation of our ranking method is that alternatives that agents rank higher than the one they receive (and thus have been rejected by) should also be ranked higher in the aggregate ranking. We introduce axioms to formalize this idea, and call any ranking that satisfies our axioms a desirable ranking. We show that as the market grows large, any desirable ranking coincides with the true underlying ranking of colleges by quality. Last, we provide an algorithm for constructing desirable rankings, and show that the outcome of this algorithm is the unique ranking of the colleges that satisfy our axioms.


title: A Dataset for Sentence Retrieval for Open-Ended Dialogues

abstract: We address the task of sentence retrieval for open-ended dialogues. The goal is to retrieve sentences from a document corpus that contain information useful for generating the next turn in a given dialogue. Prior work on dialogue-based retrieval focused on specific types of dialogues: either conversational QA or conversational search. To address a broader scope of this task where any type of dialogue can be used, we constructed a dataset that includes open-ended dialogues from Reddit, candidate sentences from Wikipedia for each dialogue and human annotations for the sentences. We report the performance of several retrieval baselines, including neural retrieval models, over the dataset. To adapt neural models to the types of dialogues in the dataset, we explored an approach to induce a large-scale weakly supervised training data from Reddit. Using this training set significantly improved the performance over training on the MS MARCO dataset.


title: On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization

abstract: Combining the visual modality with pretrained language models has been surprisingly effective for simple descriptive tasks such as image captioning. More general text generation however remains elusive. We take a step back and ask: How do these models work for more complex generative tasks, i.e. conditioning on both text and images? Are multimodal models simply visually adapted language models, or do they combine they reason jointly over modalities? We investigate these questions in the context of self-rationalization (jointly generating task labels/answers and free-text explanations) of three tasks: (i) visual question answering in VQA-X, (ii) visual commonsense reasoning in VCR, and (iii) visual-textual entailment in e-SNLI-VE. We show that recent unimodal advances, CLIP image representations and scaling of language models, do not consistently improve self-rationalization in multimodal tasks. We find that no single model type works universally best across tasks, datasets, and finetuning data sizes. Our findings motivate the need for novel general backbones approach that move text generation from images and text beyond image captioning.


title: Limiting velocities and transonic dislocations in Mg

abstract: To accurately predict the mechanical response of materials, especially at high strain rates, it is important to account for dislocation velocities in these regimes. Under these extreme conditions, it has been hypothesized that dislocations can move faster than the speed of sound. However, the presence of such dislocations remains elusive due to challenges associated with measuring these experimentally. In this work, molecular dynamics simulations were used to investigate the dislocation velocities for the basal edge, basal screw, prismatic edge, and prismatic screw dislocations in Mg in the sub-, trans-, and supersonic regimes. Our results show that only prismatic edge dislocations achieve supersonic velocities. Furthermore, this work demonstrates that the discrepancy between the theoretical limiting velocity and the MD results for Mg is due to its sensitivity to large hydrostatic stress around the dislocation core, which was not the case for fcc metals such as Cu.


title: Diagrams realizing prescribed sublink diagrams for virtual links and welded links

abstract: Jin and Lee proved the following: Suppose that $D_1, \dots, D_n$ are link diagrams. Given a link $L$ which is partitioned into sublinks $L_1, \dots, L_n$ admitting diagrams $D_1, \dots, D_n$ respectively, there is a diagram $D$ of $L$ whose restrictions to $L_1, \dots, L_n$ are isotopic to $D_1, \dots, D_n$, respectively. In this paper we show that a similar result does hold for welded links and does not for virtual links.


title: Quantum hybridization negative differential resistance from non-toxic halide perovskite nanowire heterojunctions and its strain control

abstract: While low-dimensional organometal halide perovskites are expected to open up new opportunities for a diverse range of device applications, like in their bulk counterparts, the toxicity of Pb-based halide perovskite materials is a significant concern that hinders their practical use. We recently predicted that lead triiodide (PbI$_3$) columns de-rived from trimethylsulfonium (TMS) lead triiodide (CH$_3$)$_3$SPbI$_3$ (TMSPbI$_3$) by stripping off TMS ligands should be semimetallic, and additionally ultrahigh negative differential resistance (NDR) can arise from the heterojunction composed of a TMSPbI$_3$ channel sandwiched by PbI$_3$ electrodes. Herein, we computationally explore whether similar material and device characteristics can be obtained from other one-dimensional halide perovskites based on non-Pb metal elements, and in doing so deepen the understanding of their mechanistic origins. First, scanning through several candidate metal halide inorganic frameworks as well as their parental form halide perovskites, we find that the germanium triiodide (GeI$_3$) column also assumes a semimetallic character by avoiding the Peierls distortion. Next, adopting the bundled nanowire GeI$_3$-TMSGeI$_3$-GeI$_3$ junction configuration, we obtain a drastically high peak current density and ultrahigh NDR at room temperature. Furthermore, the robustness and controllability of NDR signals under strain are revealed, establishing its potential for flexible electronics applications. It will be emphasized that, despite the performance metrics notably enhanced over those from the PbI$_3$-TMSPbI$_3$-PbI$_3$ case, these device characteristics still arise from the identical quantum hybridization NDR mechanism.


title: Workflow Discovery from Dialogues in the Low Data Regime

abstract: Text-based dialogues are now widely used to solve real-world problems. In cases where solution strategies are already known, they can sometimes be codified into workflows and used to guide humans or artificial agents through the task of helping clients. We introduce a new problem formulation that we call Workflow Discovery (WD) in which we are interested in the situation where a formal workflow may not yet exist. Still, we wish to discover the set of actions that have been taken to resolve a particular problem. We also examine a sequence-to-sequence (Seq2Seq) approach for this novel task. We present experiments where we extract workflows from dialogues in the Action-Based Conversations Dataset (ABCD). Since the ABCD dialogues follow known workflows to guide agents, we can evaluate our ability to extract such workflows using ground truth sequences of actions. We propose and evaluate an approach that conditions models on the set of possible actions, and we show that using this strategy, we can improve WD performance. Our conditioning approach also improves zero-shot and few-shot WD performance when transferring learned models to unseen domains within and across datasets. Further, on ABCD a modified variant of our Seq2Seq method achieves state-of-the-art performance on related but different problems of Action State Tracking (AST) and Cascading Dialogue Success (CDS) across many evaluation metrics.


title: High-Order Pooling for Graph Neural Networks with Tensor Decomposition

abstract: Graph Neural Networks (GNNs) are attracting growing attention due to their effectiveness and flexibility in modeling a variety of graph-structured data. Exiting GNN architectures usually adopt simple pooling operations (eg. sum, average, max) when aggregating messages from a local neighborhood for updating node representation or pooling node representations from the entire graph to compute the graph representation. Though simple and effective, these linear operations do not model high-order non-linear interactions among nodes. We propose the Tensorized Graph Neural Network (tGNN), a highly expressive GNN architecture relying on tensor decomposition to model high-order non-linear node interactions. tGNN leverages the symmetric CP decomposition to efficiently parameterize permutation-invariant multilinear maps for modeling node interactions. Theoretical and empirical analysis on both node and graph classification tasks show the superiority of tGNN over competitive baselines. In particular, tGNN achieves the most solid results on two OGB node classification datasets and one OGB graph classification dataset.


title: TAILOR: Teaching with Active and Incremental Learning for Object Registration

abstract: When deploying a robot to a new task, one often has to train it to detect novel objects, which is time-consuming and labor-intensive. We present TAILOR -- a method and system for object registration with active and incremental learning. When instructed by a human teacher to register an object, TAILOR is able to automatically select viewpoints to capture informative images by actively exploring viewpoints, and employs a fast incremental learning algorithm to learn new objects without potential forgetting of previously learned objects. We demonstrate the effectiveness of our method with a KUKA robot to learn novel objects used in a real-world gearbox assembly task through natural interactions.


title: RCC-GAN: Regularized Compound Conditional GAN for Large-Scale Tabular Data Synthesis

abstract: This paper introduces a novel generative adversarial network (GAN) for synthesizing large-scale tabular databases which contain various features such as continuous, discrete, and binary. Technically, our GAN belongs to the category of class-conditioned generative models with a predefined conditional vector. However, we propose a new formulation for deriving such a vector incorporating both binary and discrete features simultaneously. We refer to this noble definition as compound conditional vector and employ it for training the generator network. The core architecture of this network is a three-layered deep residual neural network with skip connections. For improving the stability of such complex architecture, we present a regularization scheme towards limiting unprecedented variations on its weight vectors during training. This regularization approach is quite compatible with the nature of adversarial training and it is not computationally prohibitive in runtime. Furthermore, we constantly monitor the variation of the weight vectors for identifying any potential instabilities or irregularities to measure the strength of our proposed regularizer. Toward this end, we also develop a new metric for tracking sudden perturbation on the weight vectors using the singular value decomposition theory. Finally, we evaluate the performance of our proposed synthesis approach on six benchmarking tabular databases, namely Adult, Census, HCDR, Cabs, News, and King. The achieved results corroborate that for the majority of the cases, our proposed RccGAN outperforms other conventional and modern generative models in terms of accuracy, stability, and reliability.


title: All Prime Numbers Have Primitive Roots

abstract: If p is a prime, then the numbers 1, 2, ..., p-1 form a group under multiplication modulo p. A number g that generates this group is called a primitive root of p; i.e., g is such that every number between 1 and p-1 can be written as a power of g modulo p. Building on prior work in the ACL2 community, this paper describes a constructive proof that every prime number has a primitive root.


title: Using ACL2 To Teach Students About Software Testing

abstract: We report on our experience using ACL2 in the classroom to teach students about software testing. The course COSC2300 at the University of Wyoming is a mostly traditional Discrete Mathematics course, but with a clear focus on computer science applications. For instance, the section on logic and proofs is motivated by the desire to write proofs about computer software. We emphasize that the importance of software correctness falls along a spectrum with casual programs on one end and mission-critical ones on the other. Corresponding to this spectrum is a variety of tools, ranging from unit tests, randomized testing of properties, and even formal proofs. In this paper, we describe one of the major activities, in which students use the ACL2 Sedan's counter-example generation facility to investigate properties of various existing checksum algorithms used in error detection. Students are challenged to state the relevant properties correctly, so that the counter-example generation tool is used effectively in all cases, and ACL2 can find formal proofs automatically in some of those.


title: A two-dimensional space-time terahertz memory in bulk SrTiO3

abstract: Ferroelectric materials offer unprecedented ultrafast responses and are of great interest for the development of new polarizable media under the influence of an electromagnetic field. Recent research efforts have demonstrated the role of optical excitation and intense terahertz (THz) pulses in inducing a polar order and revealing a hidden phase transition in SrTiO3 (STO), respectively. Here we show that the surface of STO crystals at room temperature act as ultrafast sensors that enable sub-picosecond switching through the Kerr effect and multi-ps recording of polar THz intensity with spatial resolution below the diffraction limit through dipole alignment relaxation. The contrast sensitivity and spatial resolution achieved by in the STO sensor are significantly superior to those of present-day near-field THz sensors based on the linear Pockels effect, and more importantly, its ability to remain polarized for several picoseconds opens the door to a new strategy for building an ultrafast space-time THz memory.


title: A Mechanized Proof of Bounded Convergence Time for the Distributed Perimeter Surveillance System (DPSS) Algorithm A

abstract: The decentralized perimeter surveillance system (DPSS) seeks to provide a decentralized protocol for evenly distributing surveillance of a perimeter over time across an ensemble of unmanned aerial vehicles (UAVs) whose members may communicate only when in close proximity to each other. The protocol must also converge to an even distribution of the perimeter in bounded time. Two versions of the DPSS protocol presented in the original paper seem to converge in bounded time but only informal proofs and arguments are given. A later application of model checking to these protocols found an error in one of the key lemmas, invalidating the informal proof for one and casting doubt on the other. Therefore, a new hand proof of the convergence time for the simpler version of the DPSS protocol or algorithm, Algorithm A or DPSS-A, was developed by Jeremy Avigad and Floris van Doorn. This paper describes a mechanization of that hand proof in the logic of ACL2 and discusses three specific ACL2 utilities that proved useful for expressing and reasoning about the DPSS model.


title: VWSIM: A Circuit Simulator

abstract: VWSIM is a circuit simulator for rapid, single-flux, quantum (RSFQ) circuits. The simulator is designed to model and simulate primitive-circuit devices such as capacitors, inductors, Josephson Junctions, and can be extended to simulate other circuit families, such as CMOS. Circuit models can be provided in the native VWSIM netlist format or as SPICE-compatible netlists, which are flattened and transformed into symbolic equations that can be manipulated and simulated. Written in the ACL2 logic, VWSIM provides logical guarantees about each of the circuit models it simulates. Note, our matrix solving and evaluation routines use Common Lisp floating-point numbers, and work is ongoing to admit these models into ACL2. We currently use VWSIM to help us design self-timed, RSFQ-based circuits. Our eventual goal is to prove properties of RSFQ circuit models. The ACL2-based definition of the VWSIM simulator offers a path for specifying and verifying RSFQ circuit models.


title: A Free Group of Rotations of Rank 2

abstract: One of the key steps in the proof of the Banach-Tarski Theorem is the introduction of a free group of rotations. First, a free group of reduced words is generated where each element of the set is represented as an ACL2 list. Then we demonstrate that there is a one-to-one relation between the set of reduced words and a set of 3D rotations. In this paper we present a way to generate this set of reduced words and we prove group properties for this set. Then, we show a way to generate a set of 3D matrices using the set of reduced words. Finally we show a formalization of 3D rotations and prove that every element of the 3D matrices set is a rotation.


title: Modeling Asymptotic Complexity Using ACL2

abstract: The theory of asymptotic complexity provides an approach to characterizing the behavior of programs in terms of bounds on the number of computational steps executed or use of computational resources. We describe work using ACL2 to prove complexity properties of programs implemented in a simple imperative programming language embedding via an operational semantics in ACL2. We simultaneously prove functional properties of a program and its complexity. We illustrate our approach by describing proofs about a binary search algorithm, proving both that it implements binary search on a sorted list and that it is O(log(n)), where n is the length of the list.


title: NLO deflections for spinning particles and Kerr black holes

abstract: We employ the "KMOC" formalism of [1] to compute classical momentum deflections of spinning bodies with arbitrary spin orientations up to next-to-leading order (one loop). We do this in electrodynamics and gravity. The final result, valid for generic masses, is true for all spins at tree level and up to second (fourth) spin order for the electromagnetic (gravity) case at one loop. Furthermore, emphasis is given to the probe limit scenario where our results extend to all spin orders in the heavy source, even at next-to-leading order. We carry out our computations both using a unitarity based framework and Feynman diagrammatic approach which relies on scattering amplitudes computed on fixed backgrounds.


title: Functional Network: A Novel Framework for Interpretability of Deep Neural Networks

abstract: The layered structure of deep neural networks hinders the use of numerous analysis tools and thus the development of its interpretability. Inspired by the success of functional brain networks, we propose a novel framework for interpretability of deep neural networks, that is, the functional network. We construct the functional network of fully connected networks and explore its small-worldness. In our experiments, the mechanisms of regularization methods, namely, batch normalization and dropout, are revealed using graph theoretical analysis and topological data analysis. Our empirical analysis shows the following: (1) Batch normalization enhances model performance by increasing the global e ciency and the number of loops but reduces adversarial robustness by lowering the fault tolerance. (2) Dropout improves generalization and robustness of models by improving the functional specialization and fault tolerance. (3) The models with dierent regularizations can be clustered correctly according to their functional topological dierences, re ecting the great potential of the functional network and topological data analysis in interpretability.


title: Verified Implementation of an Efficient Term-Rewriting Algorithm for Multiplier Verification on ACL2

abstract: Automatic and efficient verification of multiplier designs, especially through a provably correct method, is a difficult problem. We show how to utilize a theorem prover, ACL2, to implement an efficient rewriting algorithm for multiplier design verification. Through a basic understanding of the features and data structures of ACL2, we created a verified program that can automatically verify various multiplier designs much faster than the other state-of-the-art tools. Additionally, users of our system have the flexibility to change the specification for the target design to verify variations of multipliers. We discuss the challenges we tackled during the development of this program as well as key implementation details for efficiency and verifiability. Those who plan to implement an efficient program on a theorem prover or those who wish to implement our multiplier verification methodology on a different system may benefit from the discussions in this paper.


title: ACL2s Systems Programming

abstract: ACL2 provides a systems programming capability that allows one to write code that uses and extends ACL2 inside of ACL2. However, for soundness reasons, ACL2 bars the unrestricted use of certain kinds of programming constructs, like destructive updates, higher-order functions, eval, and arbitrary macros. We devised a methodology for writing code in Common Lisp that allows one to access ACL2, ACL2s, and Common Lisp functionality in a unified way. We arrived at this methodology in the process of developing the ACL2 Sedan (ACL2s) and using it as a key component in formal-methods-enabled projects relating to gamified verification, education, proof checking, interfacing with external theorem provers and security. The methodology includes a library for performing ACL2 queries from Common Lisp, as well as guidelines and utilities that help address common needs. We call this methodology "ACL2s systems programming," to distinguish it from ACL2 systems programming. We show how our methodology makes it possible to easily develop tools that interface with ACL2 and ACL2s, and describe our experience using it in our research.


title: M6-Fashion: High-Fidelity Multi-modal Image Generation and Editing

abstract: The fashion industry has diverse applications in multi-modal image generation and editing. It aims to create a desired high-fidelity image with the multi-modal conditional signal as guidance. Most existing methods learn different condition guidance controls by introducing extra models or ignoring the style prior knowledge, which is difficult to handle multiple signal combinations and faces a low-fidelity problem. In this paper, we adapt both style prior knowledge and flexibility of multi-modal control into one unified two-stage framework, M6-Fashion, focusing on the practical AI-aided Fashion design. It decouples style codes in both spatial and semantic dimensions to guarantee high-fidelity image generation in the first stage. M6-Fashion utilizes self-correction for the non-autoregressive generation to improve inference speed, enhance holistic consistency, and support various signal controls. Extensive experiments on a large-scale clothing dataset M2C-Fashion demonstrate superior performances on various image generation and editing tasks. M6-Fashion model serves as a highly potential AI designer for the fashion industry.


title: Syntheto: A Surface Language for APT and ACL2

abstract: Syntheto is a surface language for carrying out formally verified program synthesis by transformational refinement in ACL2 using the APT toolkit. Syntheto aims at providing more familiarity and automation, in order to make this technology more widely usable. Syntheto is a strongly statically typed functional language that includes both executable and non-executable constructs, including facilities to state and prove theorems and facilities to apply proof-generating transformations. Syntheto is integrated into an IDE with a notebook-style, interactive interface that translates Syntheto to ACL2 definitions and APT transformation invocations, and back-translates the prover's results to Syntheto; the bidirectional translation happens behind the scenes, with the user interacting solely with Syntheto.


title: A Complex Java Code Generator for ACL2 Based on a Shallow Embedding of ACL2 in Java

abstract: This paper describes a code generator that translates ACL2 constructs to corresponding Java constructs, according to a shallow embedding of ACL2 in Java. Starting from purely functional ACL2 code, the generated Java code exhibits imperative and object-oriented features like destructive updates, loops, and overloading. The overall translation from ACL2 to Java is fairly elaborate, consisting of several ACL2-to-ACL2 pre-translation steps, an ACL2-to-Java proper translation step, and several Java-to-Java post-translation steps. Experiments suggest that the generated Java code is not much slower than the ACL2 code. The code generator can also recognize, and translate to Java, ACL2 representations of certain Java constructs, forerunning a code generation approach based on a shallow embedding of Java in ACL2 (i.e. going the other way). This code generator builds upon, and significantly extends, a simple Java code generator for ACL2 based on a deep embedding of ACL2 in Java.


title: A Proof-Generating C Code Generator for ACL2 Based on a Shallow Embedding of C in ACL2

abstract: This paper describes a C code generator for ACL2 that recognizes ACL2 representations of C constructs, according to a shallow embedding of C in ACL2, and translates those representations to the represented C constructs. The code generator also generates ACL2 theorems asserting the correctness of the C code with respect to the ACL2 code. The code generator currently supports a limited but growing subset of C that already suffices for some interesting programs. This paper also offers a general perspective on language embedding and code generation.


title: Hardware/Software Co-Assurance using the Rust Programming Language and ACL2

abstract: The Rust programming language has garnered significant interest and use as a modern, type-safe, memory-safe, and potentially formally analyzable programming language. Our interest in Rust stems from its potential as a hardware/software co-assurance language, with application to critical systems such as autonomous vehicles. We report on the first known use of Rust as a High-Level Synthesis (HLS) language. Most incumbent HLS languages are a subset of C. A Rust-based HLS brings a single modern, type-safe, and memory-safe expression language for both hardware and software realizations with high assurance. As a a study of the suitability of Rust as an HLS, we have crafted a Rust subset, inspired by Russinoff's Restricted Algorithmic C (RAC), which we have imaginatively named Restricted Algorithmic Rust, or RAR. In our first implementation of a RAR toolchain, we simply transpile the RAR source into RAC. By so doing, we leverage a number of existing hardware/software co-assurance tools with a minimum investment of time and effort. In this paper, we describe the RAR Rust subset, detail our prototype RAR toolchain, and describe the implementation and verification of several representative algorithms and data structures written in RAR, with proofs of correctness conducted using the ACL2 theorem prover.


title: SCVRL: Shuffled Contrastive Video Representation Learning

abstract: We propose SCVRL, a novel contrastive-based framework for self-supervised learning for videos. Differently from previous contrast learning based methods that mostly focus on learning visual semantics (e.g., CVRL), SCVRL is capable of learning both semantic and motion patterns. For that, we reformulate the popular shuffling pretext task within a modern contrastive learning paradigm. We show that our transformer-based network has a natural capacity to learn motion in self-supervised settings and achieves strong performance, outperforming CVRL on four benchmarks.


title: Competing spin-fluctuations in Sr$_2$RuO$_4$ and their tuning through epitaxial strain

abstract: In this study, we report the magnetic energy landscape of Sr2RuO4 employing the generalized Bloch approach within density functional theory. We identify the two dominant magnetic instabilities, ferromagnetic and spin-density-wave, together with other predominant instabilities. We show that epitaxial strain can change the overall magnetic tendency of the system, and tune the relative weight of the various magnetic instabilities in the system. Especially, the balance between spin-density wave and ferromagnetic instabilities can be controlled by the strain, and, eventually can lead to the new magnetic phases as well as superconducting phases with possibly altered pairing channels. Our findings are compared with previous theoretical models and experimental reports for the various magnetic features of the system and offer a first-principles explanation to them.


title: Possible dibaryon production at $\bar{\rm{P}}$anda with a Lagrangian approach

abstract: In order to confirm the existence of the dibaryon state $d^*(2380)$ observed at WASA@COSY, we estimate the production of the possible dibaryon and anti-dibaryon pair $d^*\bar{d}^*$ at the energy region of the upcoming experiments at $\bar{\rm{P}}$anda. Based on some qualitative properties of $d^*$ extracted from the analysez in the non-relativistic quark model, the production cross section for this spin-3 particle pair are calculated with the help of an phenomenological effective relativistic and covariant Lagrangian approach.


title: Thalamus: a brain-inspired algorithm for biologically-plausible continual learning and disentangled representations

abstract: Animals thrive in a constantly changing environment and leverage the temporal structure to learn well-factorized causal representations. In contrast, traditional neural networks suffer from forgetting in changing environments and many methods have been proposed to limit forgetting with different trade-offs. Inspired by the brain thalamocortical circuit, we introduce a simple algorithm that uses optimization at inference time to generate internal representations of the current task dynamically. The algorithm alternates between updating the model weights and a latent task embedding, allowing the agent to parse the stream of temporal experience into discrete events and organize learning about them. On a continual learning benchmark, it achieves competitive end average accuracy by mitigating forgetting, but importantly, by requiring the model to adapt through latent updates, it organizes knowledge into flexible structures with a cognitive interface to control them. Tasks later in the sequence can be solved through knowledge transfer as they become reachable within the well-factorized latent space. The algorithm meets many of the desiderata of an ideal continually learning agent in open-ended environments, and its simplicity suggests fundamental computations in circuits with abundant feedback control loops such as the thalamocortical circuits in the brain.


title: Open Droplet Microfluidics for Testing Multi-Drug Resistance and Antibiotic Resilience in Bacteria

abstract: New combinations of existing antibiotics are being investigated to combat bacterial resilience. This requires detection technologies with reasonable cost, accuracy, resolution, and throughput. Here, we present a multi -drug screening platform for bacterial cultures by combining droplet microfluidics, search algorithms, and imaging with a wide field of view. We remotely alter the chemical microenvironment around cells and test 12 combinations of resistant cell types and chemicals. Fluorescence intensity readouts allow us to infer bacterial resistance to specific antibiotics within 8 hours. The platform has potential to detect and identify parameters of bacterial resilience in cell cultures, biofilms, and microbial aggregates.