title: Hidden Cosets and Applications to Unclonable Cryptography

abstract: In this work, we study a generalization of hidden subspace states to hidden coset states (first introduced by Aaronson and Christiano [STOC '12]). This notion was considered independently by Vidick and Zhang [Eurocrypt '21], in the context of proofs of quantum knowledge from quantum money schemes. We explore unclonable properties of coset states and several applications: - We show that assuming indistinguishability obfuscation (iO), hidden coset states possess a certain direct product hardness property, which immediately implies a tokenized signature scheme in the plain model. Previously, it was known only relative to an oracle, from a work of Ben-David and Sattath [QCrypt '17]. - Combining a tokenized signature scheme with extractable witness encryption, we give a construction of an unclonable decryption scheme in the plain model. The latter primitive was recently proposed by Georgiou and Zhandry [ePrint '20], who gave a construction relative to a classical oracle. - We conjecture that coset states satisfy a certain natural (information-theoretic) monogamy-of-entanglement property. Assuming this conjecture is true, we remove the requirement for extractable witness encryption in our unclonable decryption construction, by relying instead on compute-and-compare obfuscation for the class of unpredictable distributions. This conjecture was later proved by Culf and Vidick in a follow-up work. - Finally, we give a construction of a copy-protection scheme for pseudorandom functions (PRFs) in the plain model. Our scheme is secure either assuming iO, OWF, and extractable witness encryption, or assuming iO, OWF, compute-and-compare obfuscation for the class of unpredictable distributions, and the conjectured monogamy property mentioned above. This is the first example of a copy-protection scheme with provable security in the plain model for a class of functions that is not evasive.


title: Quantifying Explainability in NLP and Analyzing Algorithms for Performance-Explainability Tradeoff

abstract: The healthcare domain is one of the most exciting application areas for machine learning, but a lack of model transparency contributes to a lag in adoption within the industry. In this work, we explore the current art of explainability and interpretability within a case study in clinical text classification, using a task of mortality prediction within MIMIC-III clinical notes. We demonstrate various visualization techniques for fully interpretable methods as well as model-agnostic post hoc attributions, and we provide a generalized method for evaluating the quality of explanations using infidelity and local Lipschitz across model types from logistic regression to BERT variants. With these metrics, we introduce a framework through which practitioners and researchers can assess the frontier between a model's predictive performance and the quality of its available explanations. We make our code available to encourage continued refinement of these methods.


title: Instabilities of heavy magnons in an anisotropic magnet

abstract: The search for new elementary particles is one of the most basic pursuits in physics, spanning from subatomic physics to quantum materials. Magnons are the ubiquitous elementary quasiparticle to describe the excitations of fully-ordered magnetic systems. But other possibilities exist, including fractional and multipolar excitations. Here, we demonstrate that strong quantum interactions exist between three flavors of elementary quasiparticles in the uniaxial spin-one magnet FeI2. Using neutron scattering in an applied magnetic field, we observe spontaneous decay between conventional and heavy magnons and the recombination of these quasiparticles into a super-heavy bound-state. Akin to other contemporary problems in quantum materials, the microscopic origin for new physics in FeI2 is the quasi-flat nature of excitation bands and the presence of Kitaev anisotropic magnetic exchange interactions.


title: Collective excitations in two-band superconductors

abstract: We investigate the eigen oscillations of internal degrees of freedom (Higgs mode and Goldstone mode) of two-band superconductors using the extended time-dependent Ginzburg-Landau theory, formulated in a work Grigorishin (2021) \cite{grig2}, for the case of two coupled order parameters by both the internal proximity effect and the drag effect. It is demonstrated, that the Goldstone mode splits into two branches: common mode oscillations with the acoustic spectrum, which is absorbed by the gauge field, and anti-phase oscillations with the energy gap (mass) in the spectrum determined by the interband coupling, which can be associated with the Leggett mode. The Higgs mode splits into two branches also: a massive one, whose energy gap vanishes at the critical temperature $T_{c}$, another massive one, whose energy gap does not vanish at $T_{c}$. It is demonstrated, that the second branch of the Higgs mode is nonphysical, and it, together with the Leggett mode, can be removed by the special choice of coefficient at the "drag" term in the Lagrangian. In the same time, such a choice leaves only one coherence length, thereby prohibiting so-called type-1.5 superconductors. We analyze experimental data about the Josephson effect between two-band superconductors. In particular, it is demonstrated, that the resonant enhancement of the DC current through a Josephson junction at a resonant bias voltage $V_{\mathrm{res}}$, when the Josephson frequency matches the frequency of some internal oscillation mode in two-band superconductors (banks), can be explained with the coupling between AC Josephson current and Higgs oscillations. Thus, explanation of this effect does not need the Leggett mode.


title: Skew Brace Enhancements

abstract: We use the structure of skew braces to enhance the biquandle counting invariant for virtual knots and links for finite biquandles defined from skew braces. We introduce two new invariants: a single-variable polynomial using skew brace ideals and a two-variable polynomial using the skew brace group structures. We provide examples to show that the new invariants are not determined by the counting invariant and hence are proper enhancements.


title: Few-shot Language Coordination by Modeling Theory of Mind

abstract: $\textit{No man is an island.}$ Humans communicate with a large community by coordinating with different interlocutors within short conversations. This ability has been understudied by the research on building neural communicative agents. We study the task of few-shot $\textit{language coordination}$: agents quickly adapting to their conversational partners' language abilities. Different from current communicative agents trained with self-play, we require the lead agent to coordinate with a $\textit{population}$ of agents with different linguistic abilities, quickly adapting to communicate with unseen agents in the population. This requires the ability to model the partner's beliefs, a vital component of human communication. Drawing inspiration from theory-of-mind (ToM; Premack& Woodruff (1978)), we study the effect of the speaker explicitly modeling the listeners' mental states. The speakers, as shown in our experiments, acquire the ability to predict the reactions of their partner, which helps it generate instructions that concisely express its communicative goal. We examine our hypothesis that the instructions generated with ToM modeling yield better communication performance in both a referential game and a language navigation task. Positive results from our experiments hint at the importance of explicitly modeling communication as a socio-pragmatic progress.


title: Bayesian Atlas Building with Hierarchical Priors for Subject-specific Regularization

abstract: This paper presents a novel hierarchical Bayesian model for unbiased atlas building with subject-specific regularizations of image registration. We develop an atlas construction process that automatically selects parameters to control the smoothness of diffeomorphic transformation according to individual image data. To achieve this, we introduce a hierarchical prior distribution on regularization parameters that allows multiple penalties on images with various degrees of geometric transformations. We then treat the regularization parameters as latent variables and integrate them out from the model by using the Monte Carlo Expectation Maximization (MCEM) algorithm. Another advantage of our algorithm is that it eliminates the need for manual parameter tuning, which can be tedious and infeasible. We demonstrate the effectiveness of our model on 3D brain MR images. Experimental results show that our model provides a sharper atlas compared to the current atlas building algorithms with single-penalty regularizations. Our code is publicly available at https://github.com/jw4hv/HierarchicalBayesianAtlasBuild.


title: Reed Solomon Codes Against Adversarial Insertions and Deletions

abstract: In this work, we study the performance of Reed--Solomon codes against adversarial insertion-deletion (insdel) errors. We prove that over fields of size $n^{O(k)}$ there are $[n,k]$ Reed-Solomon codes that can decode from $n-2k+1$ insdel errors and hence attain the half-Singleton bound. We also give a deterministic construction of such codes over much larger fields (of size $n^{k^{O(k)}}$). Nevertheless, for $k=O(\log n /\log\log n)$ our construction runs in polynomial time. For the special case $k=2$, which received a lot of attention in the literature, we construct an $[n,2]$ Reed-Solomon code over a field of size $O(n^4)$ that can decode from $n-3$ insdel errors. Earlier constructions required an exponential field size. Lastly, we prove that any such construction requires a field of size $\Omega(n^3)$.


title: Approximating Equilibrium under Constrained Piecewise Linear Concave Utilities with Applications to Matching Markets

abstract: We study the equilibrium computation problem in the Fisher market model with constrained piecewise linear concave (PLC) utilities. This general class captures many well-studied special cases, including markets with PLC utilities, markets with satiation, and matching markets. For the special case of PLC utilities, although the problem is PPAD-hard, Devanur and Kannan (FOCS 2008) gave a polynomial-time algorithm when the number of items is constant. Our main result is a fixed parameter approximation scheme for computing an approximate equilibrium, where the parameters are the number of agents and the approximation accuracy. This provides an answer to an open question by Devanur and Kannan for PLC utilities, and gives a simpler and faster algorithm for matching markets as the one by Alaei, Jalaly and Tardos (EC 2017). The main technical idea is to work with the stronger concept of thrifty equilibria, and approximating the input utility functions by `robust' utilities that have favorable marginal properties. With some restrictions, the results also extend to the Arrow--Debreu exchange market model.


title: Scale-dependent irreversibility in living matter

abstract: A defining feature of living matter is the ability to harness energy to self-organize multiscale structures whose functions are facilitated by irreversible nonequilibrium dynamics. While progress has been made in elucidating the underlying principles, what remains unclear is the role that thermodynamics plays in shaping these structures and their ensuing functions. Here, we unravel how a fundamental thermodynamic connection between the physical energy dissipation sustaining a nonequilibrium system and a measure of statistical irreversibility (arrow of time), can provide quantitative insight into the mechanisms of nonequilibrium activity across scales. Specifically, we introduce a multiscale irreversibility metric and demonstrate how it can be used to extract model-independent estimates of dissipative timescales. Using this metric, we measure the dissipation timescale of a multiscale cellular structure - the actomyosin cortex - and further observe that the irreversibility metric maintains a monotonic relationship with the underlying biological nonequilibrium activity. Additionally, the irreversibility metric can detect shifts in the dissipative timescales when we induce spatiotemporal patterns of biochemical signaling proteins upstream of actomyosin activation. Our experimental measurements are complemented by a theoretical analysis of a generic class of nonequilibrium dynamics, elucidating how dissipative timescales manifest in multiscale irreversibility.


title: Binary Black Hole Formation with Detailed Modeling: Stable Mass Transfer Leads to Lower Merger Rates

abstract: Rapid binary population synthesis codes are often used to investigate the evolution of compact-object binaries. They typically rely on analytical fits of single-star evolutionary tracks and parameterized models for interactive phases of evolution (e.g., mass-transfer on thermal timescale, determination of dynamical instability, and common envelope) that are crucial to predict the fate of binaries. These processes can be more carefully implemented in stellar structure and evolution codes such as MESA. To assess the impact of such improvements, we compare binary black hole mergers as predicted in models with the rapid binary population synthesis code COSMIC to models ran with MESA simulations through mass transfer and common-envelope treatment. We find that results significantly differ in terms of formation paths, the orbital periods and mass ratios of merging binary black holes, and consequently merger rates. While common-envelope evolution is the dominant formation channel in COSMIC, stable mass transfer dominates in our MESA models. Depending upon the black hole donor mass, and mass-transfer and common-envelope physics, at sub-solar metallicity COSMIC overproduces the number of binary black hole mergers by factors of 2--35 with a significant fraction of them having merger times orders of magnitude shorter than the binary black holes formed when using detailed MESA models. Therefore we find that some binary black hole merger rate predictions from rapid population syntheses of isolated binaries may be overestimated by factors of ~5--500. We conclude that the interpretation of gravitational-wave observations requires the use of detailed treatment of these interactive binary phases.


title: $C^{0,\alpha}$ boundary regularity for the pressure in weak solutions of the $2d$ Euler equations

abstract: The purpose of this note is to give a complete proof of a $C^{0,\alpha}$ regularity result for the pressure for weak solutions of the two-dimensional "incompressible Euler equations" when the fluid velocity enjoys the same type of regularity in a compact simply connected domain with $C^2$ boundary. To accomplish our result we realize that it is compulsory to introduce a new weak formulation for the boundary condition of the pressure which is consistent with, and equivalent to, that of classical solutions.


title: How Could Equality and Data Protection Law Shape AI Fairness for People with Disabilities?

abstract: This article examines the concept of 'AI fairness' for people with disabilities from the perspective of data protection and equality law. This examination demonstrates that there is a need for a distinctive approach to AI fairness that is fundamentally different to that used for other protected characteristics, due to the different ways in which discrimination and data protection law applies in respect of Disability. We articulate this new agenda for AI fairness for people with disabilities, explaining how combining data protection and equality law creates new opportunities for disabled people's organisations and assistive technology researchers alike to shape the use of AI, as well as to challenge potential harmful uses.


title: Uniqueness of an entire function sharing two values jointly with its differential polynomials

abstract: In this paper, we continue to investigate the uniqueness problem when an entire function $f$ and its linear differential polynomial $L(f)$ share two distinct complex values CMW (counting multiplicities in the weak sense) jointly. Also, We investigate the same problem when $f$ and its differential monomial $M(f)$ share two distinct complex values CMW. Our results generalize the recent result of Lahiri (Comput. Methods Funct. Theory, https://doi.org/10.1007/s40315-020-00355-4).


title: Synthetic Geometry in Hyperbolic Simplices

abstract: Let $\tau$ be an $n$-simplex and let $g$ be a metric on $\tau$ with constant curvature $\kappa$. The lengths that $g$ assigns to the edges of $\tau$, along with the value of $\kappa$, uniquely determine all of the geometry of $(\tau, g)$. In this paper we focus on hyperbolic simplices ($\kappa = -1$) and develop geometric formulas which rely only on the edge lengths of $\tau$. Our main results are distance and projection formulas in hyperbolic simplices, as well as a projection formula in Euclidean simplices. We also provide analogous formulas in simplices with arbitrary constant curvature $\kappa$.


title: Computational modelling and data-driven homogenisation of knitted membranes

abstract: Knitting is an effective technique for producing complex three-dimensional surfaces owing to the inherent flexibility of interlooped yarns and recent advances in manufacturing providing better control of local stitch patterns. Fully yarn-level modelling of large-scale knitted membranes is not feasible. Therefore, we use a two-scale homogenisation approach and model the membrane as a Kirchhoff-Love shell on the macroscale and as Euler-Bernoulli rods on the microscale. The governing equations for both the shell and the rod are discretised with cubic B-spline basis functions. For homogenisation we consider only the in-plane response of the membrane. The solution of the nonlinear microscale problem requires a significant amount of time due to the large deformations and the enforcement of contact constraints, rendering conventional online computational homogenisation approaches infeasible. To sidestep this problem, we use a pre-trained statistical Gaussian Process Regression (GPR) model to map the macroscale deformations to macroscale stresses. During the offline learning phase, the GPR model is trained by solving the microscale problem for a sufficiently rich set of deformation states obtained by either uniform or Sobol sampling. The trained GPR model encodes the nonlinearities and anisotropies present in the microscale and serves as a material model for the membrane response of the macroscale shell. The bending response can be chosen in dependence of the mesh size to penalise the fine out-of-plane wrinkling of the membrane. After verifying and validating the different components of the proposed approach, we introduce several examples involving membranes subjected to tension and shear to demonstrate its versatility and good performance.


title: Untargeted Effects in Organic Exciton-Polariton Transient Spectroscopy: A Cautionary Tale

abstract: Strong light-matter coupling to form exciton- and vibropolaritons is increasingly touted as a powerful tool to alter the fundamental properties of organic materials. It is proposed that these states and their facile tunability can be used to rewrite molecular potential energy landscapes and redirect photophysical pathways, with applications from catalysis to electronic devices. Crucial to their photophysical properties is the exchange of energy between coherent, bright polaritons and incoherent dark states. One of the most potent tools to explore this interplay is transient absorption/reflectance spectroscopy. Previous studies have revealed unexpectedly long lifetimes of the coherent polariton states, for which there is no theoretical explanation. Applying these transient methods to a series of strong-coupled organic microcavities, we recover similar long-lived spectral effects. Based on transfer-matrix modelling of the transient experiment, we find that virtually the entire photoresponse results from photoexcitation effects other than the generation of polariton states. Our results suggest that the complex optical properties of polaritonic systems make them especially prone to misleading optical signatures, and that more challenging high-time-resolution measurements on high-quality microcavities are necessary to uniquely distinguish the coherent polariton dynamics.


title: Optimal input representation in neural systems at the edge of chaos

abstract: Shedding light onto how biological systems represent, process and store information in noisy environments is a key and challenging goal. A stimulating, though controversial, hypothesis poses that operating in dynamical regimes near the edge of a phase transition, i.e. at criticality or the "edge of chaos", can provide information-processing living systems with important operational advantages, creating, e.g., an optimal trade-off between robustness and flexibility. Here, we elaborate on a recent theoretical result, which establishes that the spectrum of covariance matrices of neural networks representing complex inputs in a robust way needs to decay as a power-law of the rank, with an exponent close to unity, a result that has been indeed experimentally verified in neurons of the mouse visual cortex. Aimed at understanding and mimicking these results, we construct an artificial neural network and train it to classify images. Remarkably, we find that the best performance in such a task is obtained when the network operates near the critical point, at which the eigenspectrum of the covariance matrix follows the very same statistics as actual neurons do. Thus, we conclude that operating near criticality can also have -- besides the usually alleged virtues -- the advantage of allowing for flexible, robust and efficient input representations.


title: Rodrigues' descendants of a polynomial and Boutroux curves

abstract: Motivated by the classical Rodrigues' formula, we study the root asymptotic of the polynomial sequence $$R_{[\alpha n],n,P}(z)=\frac{d^{[\alpha n]}P^n(z)}{dz^{[\alpha n]}}, n= 0,1,\dots$$ where ${P(z)}$ is a fixed univariate polynomial, $\alpha $ is a fixed positive number smaller than deg $P$, and $[\alpha n]$ stands for the integer part of $\alpha n$. Our description of this asymptotic is expressed in terms of an explicit harmonic function uniquely determined by the plane rational curve emerging from the application of the saddle point method to the integral representation of the latter polynomials using Cauchy's formula for higher derivatives. As a consequence of our method, we conclude that this curve is birationally equivalent to the zero locus of the bivariate algebraic equation satisfied by the Cauchy transform of the asymptotic root-counting measure for the latter polynomial sequence. We show that this harmonic function is also associated with an abelian differential having only purely imaginary periods and the latter plane curve belongs to the class of Boutroux curves initially introduced by Bertola. As an additional relevant piece of information, we derive a linear ordinary differential equation satisfied by $\{R_{[\alpha n],n,P}(z)\}$ as well as higher derivatives of powers of more general functions.


title: Robustness of controlled fusion frames under erasures of subspaces and the approximation operator

abstract: Controlled frames which presented to improve the numerical output of iterative algorithms for inverting the frame operator, have been introduced by Balazs and et al. Also, these frames are used by Bogdanova and et al. for spherical wavelets. In this note, we aim to study some new results about controlled fusion frames and behavior of them under erasures. Finally, we will introduce the approximation operator for these frames and a result of the composition of the operators of two controlled fusion frames will be proved.


title: A Closer Look at the Adversarial Robustness of Information Bottleneck Models

abstract: We study the adversarial robustness of information bottleneck models for classification. Previous works showed that the robustness of models trained with information bottlenecks can improve upon adversarial training. Our evaluation under a diverse range of white-box $l_{\infty}$ attacks suggests that information bottlenecks alone are not a strong defense strategy, and that previous results were likely influenced by gradient obfuscation.


title: The quantum condition space

abstract: In this work we first propose to exploit the fundamental properties of quantum physics to evaluate the probability of events with projection measurements. Next, to study what events can be specified by quantum methods, we introduce the concept of the condition space, which is found to be the dual space of the classical outcome space of bit strings. Just like the classical outcome space generates the quantum state space, the condition space generates the quantum condition space that is the central idea of this work. The quantum condition space permits the existence of entangled conditions that have no classical equivalent. In addition, the quantum condition space is related to the quantum state space by a Fourier transform guaranteed by the Pontryagin duality, and therefore an entropic uncertainty principle can be defined. The quantum condition space offers a novel perspective of understanding quantum states with the duality picture. In addition, the quantum conditions have physical meanings and realizations of their own and thus may be studied for purposes beyond the original motivation of characterizing events for probability evaluation. Finally, the relation between the condition space and quantum circuits provides insights into how quantum states are collectively modified by quantum gates, which may lead to deeper understanding of the complexity of quantum circuits.


title: The Voronoi Diagram in Soccer: a theoretical study to measure dominance space

abstract: In this article, I argue that the concept of the standard Voronoi diagram is incorrect for the calculation of dominance area in soccer. The correct region that should replace the polygonal Voronoi region controlled by a player emerges naturally by studying the motion of the players. It turns out that the widely-used standard Voronoi diagram is true only when all 22 players have the same speed (with vanishing speed being a special case) and it should be replaced by other diagrams whose regions have more complicated boundaries. The unfortunate error happened when the mathematical concept of the Voronoi diagram that has an implicit vanishing speed for its points was transferred to soccer without looking at the kinematical issues involved in the game of soccer. For this reason, as a byproduct of this work, I argue for the promotion of "soccerdynamics", model building for soccer by looking at the underlying mechanisms and not just adopting mathematical ideas only for their appeal and beauty.


title: Bethe Ansatz Solutions for Certain Periodic Quantum Circuits

abstract: I derived Bethe Ansatz equations for two model Periodic Quantum Circuits: 1) XXZ model; 2) Chiral Hubbard Model. I obtained explicit expressions for the spectra of the strings of any length. These analytic results may be useful for calibration and error mitigations in modern engineered quantum platforms.


title: Three-dimensional Maxwellian Carroll gravity theory and the cosmological constant

abstract: In this work, we present the three-dimensional Maxwell Carroll gravity by considering the ultra-relativistic limit of the Maxwell Chern-Simons gravity theory defined in three spacetime dimensions. We show that an extension of the Maxwellian Carroll symmetry is necessary in order for the invariant tensor of the ultra-relativistic Maxwellian algebra to be non-degenerate. Consequently, we discuss the origin of the aforementioned algebra and theory as a flat limit. We show that the theoretical setup with cosmological constant yielding the extended Maxwellian Carroll Chern-Simons gravity in the vanishing cosmological constant limit is based on an enlarged extended version of the Carroll symmetry. Indeed, the latter exhibits a non-degenerate invariant tensor allowing the proper construction of a Chern-Simons gravity theory which reproduces the extended Maxwellian Carroll gravity in the flat limit.


title: Sparsifying, Shrinking and Splicing for Minimum Path Cover in Parameterized Linear Time

abstract: A minimum path cover (MPC) of a directed acyclic graph (DAG) $G = (V,E)$ is a minimum-size set of paths that together cover all the vertices of the DAG. Computing an MPC is a basic polynomial problem, dating back to Dilworth's and Fulkerson's results in the 1950s. Since the size $k$ of an MPC (also known as the width) can be small in practical applications, research has also studied algorithms whose complexity is parameterized on $k$. We obtain two new MPC parameterized algorithms for DAGs running in time $O(k^2|V|\log{|V|} + |E|)$ and $O(k^3|V| + |E|)$. We also obtain a parallel algorithm running in $O(k^2|V| + |E|)$ parallel steps and using $O(\log{|V|})$ processors (in the PRAM model). Our latter two algorithms are the first solving the problem in parameterized linear time. Finally, we present an algorithm running in time $O(k^2|V|)$ for transforming any MPC to another MPC using less than $2|V|$ distinct edges, which we prove to be asymptotically tight. As such, we also obtain edge sparsification algorithms preserving the width of the DAG with the same running time as our MPC algorithms. At the core of all our algorithms we interleave the usage of three techniques: transitive sparsification, shrinking of a path cover, and the splicing of a set of paths along a given path.


title: Duality structures for module categories of vertex operator algebras and the Feigin Fuchs boson

abstract: Huang, Lepowsky and Zhang have developed a module theory for vertex operator algebras that endows suitably chosen module categories with the structure of braided monoidal categories. Included in the theory is a functor which assigns to discretely strongly graded modules a contragredient module, obtained as a gradewise dual. In this paper, we show that this gradewise dual endows the module category with the structure of a ribbon Grothendieck-Verdier category. This duality structure is more general than that of a rigid monoidal category; in contrast to rigidity, it naturally accommodates the fact that a vertex operator algebra and its gradewise dual need not be isomorphic as modules and that the tensor product of modules over vertex operator algebras need not be exact. We develop criteria which allow the detection of ribbon Grothendieck-Verdier equivalences and use them to explore ribbon Grothendieck-Verdier structures in the example of the rank $n$ Heisenberg vertex operator algebra or chiral free boson on a not necessarily full rank even lattice with arbitrary choice of conformal vector. We show that these categories are equivalent, as ribbon Grothendieck-Verdier categories, to certain categories of graded vector spaces and categories of modules over a certain Hopf algebra.

categories: math.QA hep-th math-ph math.CT math.MP math.RT


title: Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibration

abstract: When facing uncertainty, decision-makers want predictions they can trust. A machine learning provider can convey confidence to decision-makers by guaranteeing their predictions are distribution calibrated -- amongst the inputs that receive a predicted class probabilities vector $q$, the actual distribution over classes is $q$. For multi-class prediction problems, however, achieving distribution calibration tends to be infeasible, requiring sample complexity exponential in the number of classes $C$. In this work, we introduce a new notion -- \emph{decision calibration} -- that requires the predicted distribution and true distribution to be ``indistinguishable'' to a set of downstream decision-makers. When all possible decision makers are under consideration, decision calibration is the same as distribution calibration. However, when we only consider decision makers choosing between a bounded number of actions (e.g. polynomial in $C$), our main result shows that decisions calibration becomes feasible -- we design a recalibration algorithm that requires sample complexity polynomial in the number of actions and the number of classes. We validate our recalibration algorithm empirically: compared to existing methods, decision calibration improves decision-making on skin lesion and ImageNet classification with modern neural network predictors.


title: SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking

abstract: In neural Information Retrieval, ongoing research is directed towards improving the first retriever in ranking pipelines. Learning dense embeddings to conduct retrieval using efficient approximate nearest neighbors methods has proven to work well. Meanwhile, there has been a growing interest in learning sparse representations for documents and queries, that could inherit from the desirable properties of bag-of-words models such as the exact matching of terms and the efficiency of inverted indexes. In this work, we present a new first-stage ranker based on explicit sparsity regularization and a log-saturation effect on term weights, leading to highly sparse representations and competitive results with respect to state-of-the-art dense and sparse methods. Our approach is simple, trained end-to-end in a single stage. We also explore the trade-off between effectiveness and efficiency, by controlling the contribution of the sparsity regularization.


title: Demonstration of high-efficiency photonic lantern couplers for PolyOculus

abstract: The PolyOculus technology produces large-area-equivalent telescopes by using fiber optics to link modules of multiple semi-autonomous, small, inexpensive, commercial-off-the-shelf telescopes. Crucially, this scalable design has construction costs which are > 10x lower than equivalent traditional large-area telescopes. We have developed a novel photonic lantern approach for the PolyOculus fiber optic linkages which potentially offers substantial advantages over previously considered free-space optical linkages, including much higher coupling efficiencies. We have carried out the first laboratory tests of a photonic lantern prototype developed for PolyOculus, and demonstrate broadband efficiencies of ~91%, confirming the outstanding performance of this technology.


title: COPER: a Query-adaptable Semantics-based Search Engine for Persian COVID-19 Articles

abstract: With the surge of pretrained language models, a new pathway has been opened to incorporate Persian text contextual information. Meanwhile, as many other countries, including Iran, are fighting against COVID-19, a plethora of COVID-19 related articles has been published in Iranian Healthcare magazines to better inform the public of the situation. However, finding answers in this sheer volume of information is an extremely difficult task. In this paper, we collected a large dataset of these articles, leveraged different BERT variations as well as other keyword models such as BM25 and TF-IDF, and created a search engine to sift through these documents and rank them, given a user's query. Our final search engine consists of a ranker and a re-ranker, which adapts itself to the query. We fine-tune our models using Semantic Textual Similarity and evaluate them with standard task metrics. Our final method outperforms the rest by a considerable margin.


title: Decoding a black hole metric from the interferometric pattern of the relativistic images of a compact source

abstract: Photons emitted by light sources in the neighbourhood of a black hole can wind several times around it before fleeing towards the observer. For spherically symmetric black holes, two infinite sequences of images are created for any given source, asymptotically approaching the shadow border with decreasing magnitude. These sequences are reflected by a characteristic staircase structure in the complex visibility function that may be used to decode the properties of the black hole metric. Recalling the formalism of gravitational lensing in the strong deflection limit, we derive analytical formulae for the height, the width and the periodicities of the steps in the visibility as functions of the black hole parameters for the case of a single compact and distant source. With respect to diffuse emission by the whole accretion flow, this ideal framework provides clean insight and model-independent information on the metric. These basic formulae can then be used to build visibilities for more complicated sources and track the changes induced by alternative metrics and ultimately test General Relativity. As simple examples, we include visibilities for Reissner-Nordstr\"om and Janis-Newman-Winicour metrics.


title: Hysteretic effects and magnetotransport of electrically switched CuMnAs

abstract: Antiferromagnetic spintronics allows us to explore storing and processing information in magnetic crystals with vanishing magnetization. In this manuscript, we investigate magnetoresistance effects in antiferromagnetic CuMnAs upon switching into high-resistive states using electrical pulses. By employing magnetic field sweeps up to 14 T and magnetic field pulses up to $\sim$ 60 T, we reveal hysteretic phenomena and changes in the magnetoresistance, as well as the resilience of the switching signal in CuMnAs to the high magnetic field. These properties of the switched state are discussed in the context of recent studies of antiferromagnetic textures in CuMnAs.


title: Proton light yield of fast plastic scintillators for neutron imaging

abstract: Plastic organic scintillators have been tailored in composition to achieve ultra-fast temporal response, thereby enabling the design and development of fast neutron detection systems with high timing resolution. Eljen Technology's plastic organic scintillators -- EJ-230, EJ-232, and EJ-232Q -- are prospective candidates for use in emerging neutron imaging systems, where fast timing is paramount. To support the neutron response characterization of these materials, the relative proton light yields of EJ-230, EJ-232, and EJ-232Q were measured at the 88-Inch Cyclotron at Lawrence Berkeley National Laboratory. Using a broad-spectrum neutron source and a double time-of-flight technique, the proton light yield relations were obtained over a proton recoil energy range of approximately 300 keV to 4 MeV. The EJ-230, EJ-232, and EJ-232Q scintillators exhibited similar proton light yield relations to each other as well as to other plastic scintillators with the same polymer base material. A comparison of the relative proton light yield of different sized cylindrical EJ-232 and EJ-232Q scintillators also revealed consistent results. This work provides key input data for the realistic computational modeling of neutron detection technologies employing these materials, thereby supporting new capabilities in near-field radionuclide detection for national security applications.


title: Modeling mechanochemical pattern formation in elastic sheets of biological matter

abstract: Inspired by active shape morphing in developing tissues and biomaterials, we investigate two generic mechanochemical models where the deformations of a thin elastic sheet are driven by, and in turn affect, the concentration gradients of a chemical signal. We develop numerical methods to study the coupled elastic deformations and chemical concentration kinetics, and illustrate with computations the formation of different patterns depending on shell thickness, strength of mechanochemical coupling and diffusivity. In the first model, the sheet curvature governs the production of a contractility inhibitor and depending on the threshold in the coupling, qualitatively different patterns occur. The second model is based on the stress--dependent activity of myosin motors, and demonstrates how the concentration distribution patterns of molecular motors are affected by the long-range deformations generated by them. Since the propagation of mechanical deformations is typically faster than chemical kinetics (of molecular motors or signaling agents that affect motors), we describe in detail and implement a numerical method based on separation of timescales to effectively simulate such systems. We show that mechanochemical coupling leads to long-range propagation of patterns in disparate systems through elastic instabilities even without the diffusive or advective transport of the chemicals.


title: Efficient edge-preserving methods for dynamic inverse problems

abstract: We consider efficient methods for computing solutions to dynamic inverse problems, where both the quantities of interest and the forward operator (measurement process) may change at different time instances but we want to solve for all the images simultaneously. We are interested in large-scale ill-posed problems that are made more challenging by their dynamic nature and, possibly, by the limited amount of available data per measurement step. To remedy these difficulties, we apply regularization methods that enforce simultaneous regularization in space and time (such as edge enhancement at each time instant and proximity at consecutive time instants) and achieve this with low computational cost and enhanced accuracy. More precisely, we develop iterative methods based on a majorization-minimization (MM) strategy with quadratic tangent majorant, which allows the resulting least squares problem to be solved with a generalized Krylov subspace (GKS) method; the regularization parameter can be defined automatically and efficiently at each iteration. Numerical examples from a wide range of applications, such as limited-angle computerized tomography (CT), space-time image deblurring, and photoacoustic tomography (PAT), illustrate the effectiveness of the described approaches.


title: Toward Efficient Transfer Learning in 6G

abstract: 6G networks will greatly expand the support for data-oriented, autonomous applications for over the top (OTT) and networking use cases. The success of these use cases will depend on the availability of big data sets which is not practical in many real scenarios due to the highly dynamic behavior of systems and the cost of data collection procedures. Transfer learning (TL) is a promising approach to deal with these challenges through the sharing of knowledge among diverse learning algorithms. with TL, the learning rate and learning accuracy can be considerably improved. However, there are implementation challenges to efficiently deploy and utilize TL in 6G. In this paper, we initiate this discussion by providing some performance metrics to measure the TL success. Then, we show how infrastructure, application, management, and training planes of 6G can be adapted to handle TL. We provide examples of TL in 6G and highlight the spatio-temporal features of data in 6G that can lead to efficient TL. By simulation results, we demonstrate how transferring the quantized neural network weights between two use cases can make a trade-off between overheads and performance and attain more efficient TL in 6G. We also provide a list of future research directions in TL for 6G.


title: Generalization of graph network inferences in higher-order graphical models

abstract: Probabilistic graphical models provide a powerful tool to describe complex statistical structure, with many real-world applications in science and engineering from controlling robotic arms to understanding neuronal computations. A major challenge for these graphical models is that inferences such as marginalization are intractable for general graphs. These inferences are often approximated by a distributed message-passing algorithm such as Belief Propagation, which does not always perform well on graphs with cycles, nor can it always be easily specified for complex continuous probability distributions. Such difficulties arise frequently in expressive graphical models that include intractable higher-order interactions. In this paper we define the Recurrent Factor Graph Neural Network (RF-GNN) to achieve fast approximate inference on graphical models that involve many-variable interactions. Experimental results on several families of graphical models demonstrate the out-of-distribution generalization capability of our method to different sized graphs, and indicate the domain in which our method outperforms Belief Propagation (BP). Moreover, we test the RF-GNN on a real-world Low-Density Parity-Check dataset as a benchmark along with other baseline models including BP variants and other GNN methods. Overall we find that RF-GNNs outperform other methods under high noise levels.


title: Latent Deformation Models for Multivariate Functional Data and Time Warping Separability

abstract: Multivariate functional data present theoretical and practical complications which are not found in univariate functional data. One of these is a situation where the component functions of multivariate functional data are positive and are subject to mutual time warping. That is, the component processes exhibit a common shape but are subject to systematic phase variation across their domains in addition to subject-specific time warping, where each subject has its own internal clock. This motivates a novel model for multivariate functional data that connects such mutual time warping to a latent deformation-based framework by exploiting a novel time warping separability assumption. This separability assumption allows for meaningful interpretation and dimension reduction. The resulting Latent Deformation Model is shown to be well suited to represent commonly encountered functional vector data. The proposed approach combines a random amplitude factor for each component with population based registration across the components of a multivariate functional data vector and includes a latent population function, which corresponds to a common underlying trajectory. We propose estimators for all components of the model, enabling implementation of the proposed data-based representation for multivariate functional data and downstream analyses such as Fr\'echet regression. Rates of convergence are established when curves are fully observed or observed with measurement error. The usefulness of the model, interpretations, and practical aspects are illustrated in simulations and with application to multivariate human growth curves and multivariate environmental pollution data.


title: Detecting Ideal Instagram Influencer Using Social Network Analysis

abstract: Social Media is a key aspect of modern society where people share their thoughts, views, feelings and sentiments. Over the last few years, the inflation in popularity of social media has resulted in a monumental increase in data. Users use this medium to express their thoughts, feelings, and opinions on a wide variety of subjects, including politics and celebrities. Social Media has thus evolved into a lucrative platform for companies to expand their scope and improve their prospects. The paper focuses on social network analysis (SNA) for a real-world online marketing strategy. The study contributes by comparing various centrality measures to identify the most central nodes in the network and uses a linear threshold model to understand the spreading behaviour of individual users. In conclusion, the paper correlates different centrality measures and spreading behaviour to identify the most influential user in the network


title: The Impact of Mixing Treatments on Cloud Modelling in 3D Simulations of Hot Jupiters

abstract: We present results of 3D hydrodynamical simulations of HD209458b including a coupled, radiatively-active cloud model ({\sc EddySed}). We investigate the role of the mixing by replacing the default convective treatment used in previous works with a more physically relevant mixing treatment ($K_{zz}$) based on global circulation. We find that uncertainty in the efficiency of sedimentation through the sedimentation factor $f_\mathrm{sed}$ plays a larger role in shaping cloud thickness and its radiative feedback on the local gas temperatures -- e.g. hot spot shift and day-to-night side temperature gradient -- than the switch in mixing treatment. We demonstrate using our new mixing treatments that simulations with cloud scales which are a fraction of the pressure scale height improve agreement with the observed transmission spectra, the emission spectra, and the Spitzer 4.5 $\mathrm{\mu m}$ phase curve, although our models are still unable to reproduce the optical and UV transmission spectra. We also find that the inclusion of cloud increases the transit asymmetry in the optical between the east and west limbs, although the difference remains small ($\lesssim 1\%$).


title: Theory and simulation of electrokinetic fluctuations in electrolyte solutions at the mesoscale

abstract: Electrolyte solutions play an important role in energy storage devices, whose performance highly relies on the electrokinetic processes at sub-micron scales.\ Although fluctuations and stochastic features become more critical at small scales, the long-range Coulomb interactions pose a particular challenge for both theoretical analysis and simulation of fluid systems with fluctuating hydrodynamic and electrostatic interactions. Here, we present a theoretical framework based on the Landau-Lifshitz theory to derive closed-form expressions of fluctuation correlations in electrolyte solutions, indicating significantly different decorrelation processes of ionic concentration fluctuations from hydrodynamic fluctuations, which provides insights for understanding transport phenomena of coupled fluctuating hydrodynamics and electrokinetics. Furthermore, we simulate fluctuating electrokinetic systems using both molecular dynamics (MD) with explicit ions and mesoscopic charged dissipative particle dynamics (cDPD) with semi-implicit ions, from which we identify that the spatial probability density functions of local charge density follow Gamma distribution at sub-nanometer scale (i.e., 0.3 nm) and converge to Gaussian distribution above nanometer scales (i.e., 1.55 nm), indicating the existence of a lower limit of length scale for mesoscale models using Gaussian fluctuations. The temporal correlation functions of both hydrodynamic and electrokinetic fluctuations are computed from all-atom MD and mesoscale cDPD simulations, showing a good agreement with the theoretical predictions based on the linearized fluctuating hydrodynamics theory.


title: Assessment of Immune Correlates of Protection via Controlled Vaccine Efficacy and Controlled Risk

abstract: Immune correlates of protection (CoPs) are immunologic biomarkers accepted as a surrogate for an infectious disease clinical endpoint and thus can be used for traditional or provisional vaccine approval. To study CoPs in randomized, placebo-controlled trials, correlates of risk (CoRs) are first assessed in vaccine recipients. This analysis does not assess causation, as a CoR may fail to be a CoP. We propose a causal CoP analysis that estimates the controlled vaccine efficacy curve across biomarker levels $s$, $CVE(s)$, equal to one minus the ratio of the controlled-risk curve $r_C(s)$ at $s$ and placebo risk, where $r_C(s)$ is causal risk if all participants are assigned vaccine and the biomarker is set to $s$. The criterion for a useful CoP is wide variability of $CVE(s)$ in $s$. Moreover, estimation of $r_C(s)$ is of interest in itself, especially in studies without a placebo arm. For estimation of $r_C(s)$, measured confounders can be adjusted for by any regression method that accommodates missing biomarkers, to which we add sensitivity analysis to quantify robustness of CoP evidence to unmeasured confounding. Application to two harmonized phase 3 trials supports that 50% neutralizing antibody titer has value as a controlled vaccine efficacy CoP for virologically confirmed dengue (VCD): in CYD14 the point estimate (95% confidence interval) for $CVE(s)$ accounting for measured confounders and building in conservative margin for unmeasured confounding increases from 29.6% (95% CI 3.5 to 45.9) at titer 1:36 to 78.5% (95% CI 67.9 to 86.8) at titer 1:1200; these estimates are 17.4% (95% CI -14.4 to 36.5) and 84.5% (95% CI 79.6 to 89.1) for CYD15.


title: Entanglement transitions from restricted Boltzmann machines

abstract: The search for novel entangled phases of matter has lead to the recent discovery of a new class of ``entanglement transitions'', exemplified by random tensor networks and monitored quantum circuits. Most known examples can be understood as some classical ordering transitions in an underlying statistical mechanics model, where entanglement maps onto the free energy cost of inserting a domain wall. In this paper, we study the possibility of entanglement transitions driven by physics beyond such statistical mechanics mappings. Motivated by recent applications of neural network-inspired variational Ans\"atze, we investigate under what conditions on the variational parameters these Ans\"atze can capture an entanglement transition. We study the entanglement scaling of short-range restricted Boltzmann machine (RBM) quantum states with random phases. For uncorrelated random phases, we analytically demonstrate the absence of an entanglement transition and reveal subtle finite size effects in finite size numerical simulations. Introducing phases with correlations decaying as $1/r^\alpha$ in real space, we observe three regions with a different scaling of entanglement entropy depending on the exponent $\alpha$. We study the nature of the transition between these regions, finding numerical evidence for critical behavior. Our work establishes the presence of long-range correlated phases in RBM-based wave functions as a required ingredient for entanglement transitions.


title: Affect Expression Behaviour Analysis in the Wild using Consensual Collaborative Training

abstract: Facial expression recognition (FER) in the wild is crucial for building reliable human-computer interactive systems. However, annotations of large scale datasets in FER has been a key challenge as these datasets suffer from noise due to various factors like crowd sourcing, subjectivity of annotators, poor quality of images, automatic labelling based on key word search etc. Such noisy annotations impede the performance of FER due to the memorization ability of deep networks. During early learning stage, deep networks fit on clean data. Then, eventually, they start overfitting on noisy labels due to their memorization ability, which limits FER performance. This report presents Consensual Collaborative Training (CCT) framework used in our submission to expression recognition track of the Affective Behaviour Analysis in-the-wild (ABAW) 2021 competition. CCT co-trains three networks jointly using a convex combination of supervision loss and consistency loss, without making any assumption about the noise distribution. A dynamic transition mechanism is used to move from supervision loss in early learning to consistency loss for consensus of predictions among networks in the later stage. Co-training reduces overall error, and consistency loss prevents overfitting to noisy samples. The performance of the model is validated on challenging Aff-Wild2 dataset for categorical expression classification. Our code is made publicly available at https://github.com/1980x/ABAW2021DMACS.


title: Opportunities for inclusive diffraction at EIC

abstract: The possibilities for inclusive diffraction in the Electron Ion Collider, EIC, in the US, are analyzed. We find that thanks to the excellent forward proton tagging, the EIC will be able to access a wider kinematical range of longitudinal momentum fraction and momentum transfer of the leading proton than at HERA. This opens up the possibility to measure subleading diffractive exchanges. The extended $t$-range would allow the precise extraction of 4-dimensional reduced cross section in diffraction. In addition, the varying beam energy setups at the EIC would allow for precise measurements of the longitudinal diffractive structure function.


title: Demonstration of Faceted Search on Scholarly Knowledge Graphs

abstract: Scientists always look for the most accurate and relevant answer to their queries on the scholarly literature. Traditional scholarly search systems list documents instead of providing direct answers to the search queries. As data in knowledge graphs are not acquainted semantically, they are not machine-readable. Therefore, a search on scholarly knowledge graphs ends up in a full-text search, not a search in the content of scholarly literature. In this demo, we present a faceted search system that retrieves data from a scholarly knowledge graph, which can be compared and filtered to better satisfy user information needs. Our practice's novelty is that we use dynamic facets, which means facets are not fixed and will change according to the content of a comparison.


title: Results of the 2021 ECFA Early-Career Researcher Survey on Training in Instrumentation

abstract: The European Committee for Future Accelerators (ECFA) Early-Career Researchers (ECR) Panel was invited by the ECFA Detector R&D Roadmap conveners to collect feedback from the European ECR community. A working group within the ECFA ECR panel held a Townhall Meeting to get first input, and then designed and broadly circulated a detailed survey to gather feedback from the larger ECR community. A total of 473 responses to this survey were received, providing a useful overview of the experiences of ECRs in instrumentation training and related topics. This report summarises the feedback received, and is intended to serve as an input to the ECFA Detector R&D Roadmap process.


title: Wavelet Analysis of Dengue Incidence and its Correlation with Weather and Vegetation Variables in Costa Rica

abstract: Dengue represents a serious public health problem in tropical and subtropical regions worldwide. The number of dengue cases and its geographical expansion has increased in recent decades, driven mostly after by social and environmental factors. In Costa Rica, it has been endemic since it was first introduced in 1993. In this article, wavelet analyzes (wavelet power spectrum and wavelet coherence) were performed to detect and quantify dengue periodicity and describe patterns of synchrony between dengue incidence and climatic and environmental factors: Normalized Difference Water Index, Enhanced Vegetation Index, Normalized Difference Vegetation Index, Tropical North Atlantic indices, Land Surface Temperature, and El Ni\~no Southern Oscillation indices in 32 different cantons, using dengue surveillance from 2000 to 2019. Results showed that the dengue dominant cycles are in periods of 1, 2, and 3 years. The wavelet coherence analysis showed that the vegetation indices are correlated with dengue incidence in places located in the central and Northern Pacific of the country in the period of 1 year. Climatic variables such as El Ni\~no 3, 3.4, 4, showed a strong correlation with dengue incidence in the period of 3 years and the Tropical North Atlantic is correlated with dengue incidence in the period of 1 year. Land Surface Temperature showed a strong correlation with dengue time series in the 32 cantons.


title: Effects of Fine Particulate Matter on Cardiovascular Disease Morbidity: A Study on Seven Metropolitan Cities in South Korea

abstract: Objectives: The primary purpose of this study is to analyze the relationship between the first occurrence of hospitalization for cardiovascular disease (CVD) and particulate matter less than 2.5 micrometre in diameter (PM2.5) exposure, considering average PM2.5 concentration and the frequency of high PM2.5 concentration simultaneously. Methods: We used large-scale cohort data from seven metropolitan cities in South Korea. We estimated hazard ratios (HRs) and 95% confidence intervals (CIs) using the Cox proportional-hazards model, including annual average PM2.5 and annual hours of PM2.5 concentration exceeding 55.5 microgram/m3 (FH55). Results: We found that the risk was elevated by 11.6% (95% CI, 9.7-13.6) for all CVD per 2.9 microgram/m3 increase of average PM2.5. In addition, a 94-h increase in FH55 increased the risk of all CVD by 3.8% (95% CI, 2.8-4.7). Regarding stroke, we found that people who were older and had a history of hypertension were more vulnerable to PM2.5 exposure. Conclusion: Based on the findings, we conclude that accurate forecasting, information dissemination, and timely warning of high concentrations of PM2.5 at the national level may reduce the risk of CVD occurrence.


title: Nordhaus-Guddum type results for the Steiner Gutman index of graphs

abstract: Building upon the notion of Gutman index $\operatorname{SGut}(G)$, Mao and Das recently introduced the Steiner Gutman index by incorporating Steiner distance for a connected graph $G$. The \emph{Steiner Gutman $k$-index} $\operatorname{SGut}_k(G)$ of $G$ is defined by $\operatorname{SGut}_k(G)$ $=\sum_{S\subseteq V(G), \ |S|=k}\left(\prod_{v\in S}deg_G(v)\right) d_G(S)$, in which $d_G(S)$ is the Steiner distance of $S$ and $deg_G(v)$ is the degree of $v$ in $G$. In this paper, we derive new sharp upper and lower bounds on $\operatorname{SGut}_k$, and then investigate the Nordhaus-Gaddum-type results for the parameter $\operatorname{SGut}_k$. We obtain sharp upper and lower bounds of $\operatorname{SGut}_k(G)+\operatorname{SGut}_k(\overline{G})$ and $\operatorname{SGut}_k(G)\cdot \operatorname{SGut}_k(\overline{G})$ for a connected graph $G$ of order $n$, $m$ edges and maximum degree $\Delta$, minimum degree $\delta$.


title: Massive Protocluster of a Periodic Maser Source G188.95+0.89

abstract: We report the results of ongoing monitoring of the 6.7 GHz CH$_3$OH masers associated with G188.95+0.89. In these observations five features are periodically varying and at least two exhibit evidence of velocity drifts. It is not clear the cause of these velocity drifts. The spectra have varied significantly since detection in 1991. The 11.45 km s$^1$ feature has decreased exponentially from 2003. Complementary ALMA 1.3 mm continuum and line observational results are also presented. Eight continuum cores (MM1 - MM8) were detected in G188.95+0.89. We derived the masses of the detected cores. G188.95+0.89 MM2 was resolved into 2 continuum cores (separated by 0.1 arcsec) in ALMA band 7 observations. Also CH$_3$OH (4$_{(2,2)}$-3$_{(1,2)})$ thermal emission associated with MM2 is double peaked. We propose the presence of multiple (at least binary) young stellar objects in MM2. SiO emission exhibit a bow-shock morphology in MM2 while strong emission of $^{12}$CO at the east and west of MM2 suggest the presence of an east-west bipolar outflow.


title: The apparent structure of dense Sidon sets

abstract: The correspondence between perfect difference sets and transitive projective planes is well-known. We observe that all known dense (i.e., close to square-root size) Sidon subsets of abelian groups come from projective planes through a similar construction. We classify the Sidon sets arising in this manner from desarguesian planes and find essentially no new examples, but there are many further examples arising from nondesarguesian planes. We conjecture that all dense Sidon sets arise in this manner. We also give a brief bestiary of somewhat smaller Sidon sets with a variety of algebraic origins, and for some of them provide an overarching pattern.


title: Adapting to Misspecification in Contextual Bandits

abstract: A major research direction in contextual bandits is to develop algorithms that are computationally efficient, yet support flexible, general-purpose function approximation. Algorithms based on modeling rewards have shown strong empirical performance, but typically require a well-specified model, and can fail when this assumption does not hold. Can we design algorithms that are efficient and flexible, yet degrade gracefully in the face of model misspecification? We introduce a new family of oracle-efficient algorithms for $\varepsilon$-misspecified contextual bandits that adapt to unknown model misspecification -- both for finite and infinite action settings. Given access to an online oracle for square loss regression, our algorithm attains optimal regret and -- in particular -- optimal dependence on the misspecification level, with no prior knowledge. Specializing to linear contextual bandits with infinite actions in $d$ dimensions, we obtain the first algorithm that achieves the optimal $O(d\sqrt{T} + \varepsilon\sqrt{d}T)$ regret bound for unknown misspecification level $\varepsilon$. On a conceptual level, our results are enabled by a new optimization-based perspective on the regression oracle reduction framework of Foster and Rakhlin, which we anticipate will find broader use.


title: Computational Hardness of the Hylland-Zeckhauser Scheme

abstract: We study the complexity of the classic Hylland-Zeckhauser scheme [HZ'79] for one-sided matching markets. We show that the problem of finding an $\epsilon$-approximate equilibrium in the HZ scheme is PPAD-hard, and this holds even when $\epsilon$ is polynomially small and when each agent has no more than four distinct utility values. Our hardness result, when combined with the PPAD membership result of [VY'21], resolves the approximation complexity of the HZ scheme. We also show that the problem of approximating the optimal social welfare (the weight of the matching) achievable by HZ equilibria within a certain constant factor is NP-hard.


title: SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networks

abstract: Hebbian plasticity in winner-take-all (WTA) networks is highly attractive for neuromorphic on-chip learning, owing to its efficient, local, unsupervised, and on-line nature. Moreover, its biological plausibility may help overcome important limitations of artificial algorithms, such as their susceptibility to adversarial attacks, and their high demands for training-example quantity and repetition. However, Hebbian WTA learning has found little use in machine learning (ML), likely because it has been missing an optimization theory compatible with deep learning (DL). Here we show rigorously that WTA networks constructed by standard DL elements, combined with a Hebbian-like plasticity that we derive, maintain a Bayesian generative model of the data. Importantly, without any supervision, our algorithm, SoftHebb, minimizes cross-entropy, i.e. a common loss function in supervised DL. We show this theoretically and in practice. The key is a "soft" WTA where there is no absolute "hard" winner neuron. Strikingly, in shallow-network comparisons with backpropagation (BP), SoftHebb shows advantages beyond its Hebbian efficiency. Namely, it converges in fewer iterations, and is significantly more robust to noise and adversarial attacks. Notably, attacks that maximally confuse SoftHebb are also confusing to the human eye, potentially linking human perceptual robustness, with Hebbian WTA circuits of cortex. Finally, SoftHebb can generate synthetic objects as interpolations of real object classes. All in all, Hebbian efficiency, theoretical underpinning, cross-entropy-minimization, and surprising empirical advantages, suggest that SoftHebb may inspire highly neuromorphic and radically different, but practical and advantageous learning algorithms and hardware accelerators.


title: Evaluation of an Inflated Beam Model Applied to Everted Tubes

abstract: Everted tubes have often been modeled as inflated beams to determine transverse and axial buckling conditions. This paper seeks to validate the assumption that an everted tube can be modeled in this way. The tip deflections of everted and uneverted beams under transverse cantilever loads are compared with a tip deflection model that was first developed for aerospace applications. LDPE and silicone coated nylon beams were tested; everted and uneverted beams showed similar tip deflection. The literature model best fit the tip deflection of LDPE tubes with an average tip deflection error of 6 mm, while the nylon tubes had an average tip deflection error of 16.4 mm. Everted beams of both materials buckled at 83% of the theoretical buckling condition while straight beams collapsed at 109% of the theoretical buckling condition. The curvature of everted beams was estimated from a tip load and a known displacement showing relative errors of 14.2% and 17.3% for LDPE and nylon beams respectively. This paper shows a numerical method for determining inflated beam deflection. It also provides an iterative method for computing static tip pose and applied wall forces in a known environment.


title: Resurrecting Address Clustering in Bitcoin

abstract: Blockchain analysis is essential for understanding how cryptocurrencies like Bitcoin are used in practice, and address clustering is a cornerstone of blockchain analysis. However, current techniques rely on heuristics that have not been rigorously evaluated or optimized. In this paper, we tackle several challenges of change address identification and clustering. First, we build a ground truth set of transactions with known change from the Bitcoin blockchain that can be used to validate the efficacy of individual change address detection heuristics. Equipped with this data set, we develop new techniques to predict change outputs with low false positive rates. After applying our prediction model to the Bitcoin blockchain, we analyze the resulting clustering and develop ways to detect and prevent cluster collapse. Finally, we assess the impact our enhanced clustering has on two exemplary applications.


title: Which Molecular Cloud Structures Are Bound?

abstract: We analyze surveys of molecular cloud structures defined by tracers ranging from CO $J = 1-0$ through $^{13}$CO $J = 1-0$ to dust emission together with NH$_3$ data. The mean value of the virial parameter and the fraction of mass in bound structures depends on the method used to identify structures. Generally, the virial parameter decreases and the fraction of mass in bound structures increases with the effective density of the tracer, the surface density and mass of the structures, and the distance from the center of a galaxy. For the most complete surveys of structures in the Galaxy defined by CO $J = 1-0$, the fraction of mass that is in bound structures is 0.19. For catalogs of other galaxies based on CO $J = 2-1$, the fraction is 0.35. These results offer substantial alleviation of the fundamental problem of slow star formation. If only clouds found to be bound are counted and they are assumed to collapse in a free-fall time at their mean cloud density, the sum over all clouds in a complete survey of the Galaxy yields a predicted star formation rate of 46 solar masses per year, a factor of 6.5 less than if all clouds are bound.


title: Quantum Serre duality for quasimaps

abstract: Let $X$ be a smooth variety or orbifold and let $Z \subseteq X$ be a complete intersection defined by a section of a vector bundle $E \to X$. Originally proposed by Givental, quantum Serre duality refers to a precise relationship between the Gromov--Witten invariants of $Z$ and those of the dual vector bundle $E^\vee$. In this paper we prove a quantum Serre duality statement for quasimap invariants. In shifting focus to quasimaps, we obtain a comparison which is simpler and which also holds for non-convex complete intersections. By combining our results with the wall-crossing formula developed by Zhou, we recover a quantum Serre duality statement in Gromov-Witten theory without assuming convexity.


title: Simultaneous measurement of organic scintillator response to carbon and proton recoils

abstract: Background: Organic scintillators are widely used for neutron detection in both basic nuclear physics and applications. While the proton light yield of organic scintillators has been extensively studied, measurements of the light yield from neutron interactions with carbon nuclei are scarce. Purpose: Demonstrate a new approach for the simultaneous measurement of the proton and carbon light yield of organic scintillators. Provide new carbon light yield data for the EJ-309 liquid and EJ-204 plastic organic scintillators. Method: A 33~MeV $^{2}$H$^{+}$ beam from the 88-Inch Cyclotron at Lawrence Berkeley National Laboratory was impinged upon a 3-mm-thick Be target to produce a high-flux, broad-spectrum neutron beam. The double time-of-flight technique was extended to simultaneously measure the proton and carbon light yield of the organic scintillators, wherein the light output associated with the recoil particle was determined using $np$ and $n$C elastic scattering kinematics. Results: The proton and carbon light yield relations of the EJ-309 liquid and EJ-204 plastic organic scintillators were measured over a recoil energy range of approximately 0.3 to 1~MeV and 2 to 5~MeV, respectively for EJ-309, and 0.2 to 0.5~MeV and 1 to 4~MeV, respectively for EJ-204. Conclusions: These data provide new insight into the ionization quenching effect in organic scintillators and key input for simulation of the response of organic scintillators for both basic science and a broad range of applications.


title: Noisy searching: simple, fast and correct

abstract: This work considers the problem of the noisy binary search in a sorted array. The noise is modeled by a parameter $p$ that dictates that a comparison can be incorrect with probability $p$, independently of other queries. We state two types of upper bounds on the number of queries: the worst-case and expected query complexity scenarios. The bounds improve the ones known to date, i.e., our algorithms require fewer queries. Additionally, they have simpler statements, and work for the full range of parameters. All query complexities for the expected query scenarios are tight up to lower order terms. For the problem where target prior is uniform over all possible inputs, we provide algorithm with expected complexity upperbounded by $(\log_2 n + \log_2 \delta^{-1} + 3)/I(p)$, where $n$ is the domain size, $0\le p < 1/2$ is the noise ratio, and $\delta>0$ is the failure probability, and $I(p)$ is the information gain function. As a side-effect, we close some correctness issues regarding previous work. Also, en route, we obtain new and improved query complexities for the search generalized to arbitrary graphs. This paper continues and improves upon the lines of research of Burnashev-Zigangirov [Prob. Per. Informatsii, 1974], Ben-Or and Hassidim [FOCS 2008], Gu and Xu [STOC 2023], and Emamjomeh-Zadeh et al. [STOC 2016], Dereniowski et al. [SOSA@SODA 2019].


title: EvoBA: An Evolution Strategy as a Strong Baseline forBlack-Box Adversarial Attacks

abstract: Recent work has shown how easily white-box adversarial attacks can be applied to state-of-the-art image classifiers. However, real-life scenarios resemble more the black-box adversarial conditions, lacking transparency and usually imposing natural, hard constraints on the query budget. We propose $\textbf{EvoBA}$, a black-box adversarial attack based on a surprisingly simple evolutionary search strategy. $\textbf{EvoBA}$ is query-efficient, minimizes $L_0$ adversarial perturbations, and does not require any form of training. $\textbf{EvoBA}$ shows efficiency and efficacy through results that are in line with much more complex state-of-the-art black-box attacks such as $\textbf{AutoZOOM}$. It is more query-efficient than $\textbf{SimBA}$, a simple and powerful baseline black-box attack, and has a similar level of complexity. Therefore, we propose it both as a new strong baseline for black-box adversarial attacks and as a fast and general tool for gaining empirical insight into how robust image classifiers are with respect to $L_0$ adversarial perturbations. There exist fast and reliable $L_2$ black-box attacks, such as $\textbf{SimBA}$, and $L_{\infty}$ black-box attacks, such as $\textbf{DeepSearch}$. We propose $\textbf{EvoBA}$ as a query-efficient $L_0$ black-box adversarial attack which, together with the aforementioned methods, can serve as a generic tool to assess the empirical robustness of image classifiers. The main advantages of such methods are that they run fast, are query-efficient, and can easily be integrated in image classifiers development pipelines. While our attack minimises the $L_0$ adversarial perturbation, we also report $L_2$, and notice that we compare favorably to the state-of-the-art $L_2$ black-box attack, $\textbf{AutoZOOM}$, and of the $L_2$ strong baseline, $\textbf{SimBA}$.


title: Many forcing axioms for all regular uncountable cardinals

abstract: A central theme in set theory is to find universes with extreme, well-understood behaviour. The case we are interested in is assuming GCH and has a strong forcing axiom of higher order than usual. Instead of "for every suitable forcing notion for~$\lambda$" we shall say "for every such family of forcing notions, depending on stationary $S\subseteq \lambda$, for some such stationary set we have\dots". Such notions of forcing are important for Abelian group theory, but this application is delayed for a sequel.


title: Reinforcement Learning based Proactive Control for Transmission Grid Resilience to Wildfire

abstract: Power grid operation subject to an extreme event requires decision-making by human operators under stressful condition with high cognitive load. Decision support under adverse dynamic events, specially if forecasted, can be supplemented by intelligent proactive control. Power system operation during wildfires require resiliency-driven proactive control for load shedding, line switching and resource allocation considering the dynamics of the wildfire and failure propagation. However, possible number of line- and load-switching in a large system during an event make traditional prediction-driven and stochastic approaches computationally intractable, leading operators to often use greedy algorithms. We model and solve the proactive control problem as a Markov decision process and introduce an integrated testbed for spatio-temporal wildfire propagation and proactive power-system operation. We transform the enormous wildfire-propagation observation space and utilize it as part of a heuristic for proactive de-energization of transmission assets. We integrate this heuristic with a reinforcement-learning based proactive policy for controlling the generating assets. Our approach allows this controller to provide setpoints for a part of the generation fleet, while a myopic operator can determine the setpoints for the remaining set, which results in a symbiotic action. We evaluate our approach utilizing the IEEE 24-node system mapped on a hypothetical terrain. Our results show that the proposed approach can help the operator to reduce load loss during an extreme event, reduce power flow through lines that are to be de-energized, and reduce the likelihood of infeasible power-flow solutions, which would indicate violation of short-term thermal limits of transmission lines.


title: Kernel Continual Learning

abstract: This paper introduces kernel continual learning, a simple but effective variant of continual learning that leverages the non-parametric nature of kernel methods to tackle catastrophic forgetting. We deploy an episodic memory unit that stores a subset of samples for each task to learn task-specific classifiers based on kernel ridge regression. This does not require memory replay and systematically avoids task interference in the classifiers. We further introduce variational random features to learn a data-driven kernel for each task. To do so, we formulate kernel continual learning as a variational inference problem, where a random Fourier basis is incorporated as the latent variable. The variational posterior distribution over the random Fourier basis is inferred from the coreset of each task. In this way, we are able to generate more informative kernels specific to each task, and, more importantly, the coreset size can be reduced to achieve more compact memory, resulting in more efficient continual learning based on episodic memory. Extensive evaluation on four benchmarks demonstrates the effectiveness and promise of kernels for continual learning.


title: Classical description of the parameter space geometry in the Dicke and Lipkin-Meshkov-Glick models

abstract: We study the classical analog of the quantum metric tensor and its scalar curvature for two well-known quantum physics models. First, we analyze the geometry of the parameter space for the Dicke model with the aid of the classical and quantum metrics and find that, in the thermodynamic limit, they have the same divergent behavior near the quantum phase transition, as opposed to their corresponding scalar curvatures which are not divergent there. On the contrary, under resonance conditions, both scalar curvatures exhibit a divergence at the critical point. Second, we present the classical and quantum metrics for the Lipkin-Meshkov-Glick model in the thermodynamic limit and find a perfect agreement between them. We also show that the scalar curvature is only defined on one of the system's phases and that it approaches a negative constant value. Finally, we carry out a numerical analysis for the system's finite sizes, which clearly shows the precursors of the quantum phase transition in the metric and its scalar curvature and allows their characterization as functions of the parameters and of the system's size.


title: Further Evidence for Tidal Spin-Up of Hot Jupiter Host Stars

abstract: For most hot Jupiters around main-sequence Sun-like stars, tidal torques are expected to transfer angular momentum from the planet's orbit to the star's rotation. The timescale for this process is difficult to calculate, leading to uncertainties in the history of orbital evolution of hot Jupiters. We present evidence for tidal spin-up by taking advantage of recent advances in planet detection and host-star characterization. We compared the projected rotation velocities and rotation periods of Sun-like stars with hot Jupiters and spectroscopically similar stars with (i) wider-orbiting giant planets, and (ii) less massive planets. The hot Jupiter hosts tend to spin faster than the stars in either of the control samples. Reinforcing earlier studies, the results imply that hot Jupiters alter the spins of their host stars while they are on the main sequence, and that the ages of hot-Jupiter hosts cannot be reliably determined using gyrochronology.


title: Asking Clarifying Questions Based on Negative Feedback in Conversational Search

abstract: Users often need to look through multiple search result pages or reformulate queries when they have complex information-seeking needs. Conversational search systems make it possible to improve user satisfaction by asking questions to clarify users' search intents. This, however, can take significant effort to answer a series of questions starting with "what/why/how". To quickly identify user intent and reduce effort during interactions, we propose an intent clarification task based on yes/no questions where the system needs to ask the correct question about intents within the fewest conversation turns. In this task, it is essential to use negative feedback about the previous questions in the conversation history. To this end, we propose a Maximum-Marginal-Relevance (MMR) based BERT model (MMR-BERT) to leverage negative feedback based on the MMR principle for the next clarifying question selection. Experiments on the Qulac dataset show that MMR-BERT outperforms state-of-the-art baselines significantly on the intent identification task and the selected questions also achieve significantly better performance in the associated document retrieval tasks.


title: Faster Math Functions, Soundly

abstract: Standard library implementations of functions like sin and exp optimize for accuracy, not speed, because they are intended for general-purpose use. But applications tolerate inaccuracy from cancellation, rounding error, and singularities-sometimes even very high error-and many application could tolerate error in function implementations as well. This raises an intriguing possibility: speeding up numerical code by tuning standard function implementations. This paper thus introduces OpTuner, an automatic method for selecting the best implementation of mathematical functions at each use site. OpTuner assembles dozens of implementations for the standard mathematical functions from across the speed-accuracy spectrum. OpTuner then uses error Taylor series and integer linear programming to compute optimal assignments of function implementation to use site and presents the user with a speed-accuracy Pareto curve they can use to speed up their code. In a case study on the POV-Ray ray tracer, OpTuner speeds up a critical computation, leading to a whole program speedup of 9% with no change in the program output (whereas human efforts result in slower code and lower-quality output). On a broader study of 37 standard benchmarks, OpTuner matches 216 implementations to 89 use sites and demonstrates speed-ups of 107% for negligible decreases in accuracy and of up to 438% for error-tolerant applications.


title: Strategic Instrumental Variable Regression: Recovering Causal Relationships From Strategic Responses

abstract: In settings where Machine Learning (ML) algorithms automate or inform consequential decisions about people, individual decision subjects are often incentivized to strategically modify their observable attributes to receive more favorable predictions. As a result, the distribution the assessment rule is trained on may differ from the one it operates on in deployment. While such distribution shifts, in general, can hinder accurate predictions, our work identifies a unique opportunity associated with shifts due to strategic responses: We show that we can use strategic responses effectively to recover causal relationships between the observable features and outcomes we wish to predict, even under the presence of unobserved confounding variables. Specifically, our work establishes a novel connection between strategic responses to ML models and instrumental variable (IV) regression by observing that the sequence of deployed models can be viewed as an instrument that affects agents' observable features but does not directly influence their outcomes. We show that our causal recovery method can be utilized to improve decision-making across several important criteria: individual fairness, agent outcomes, and predictive risk. In particular, we show that if decision subjects differ in their ability to modify non-causal attributes, any decision rule deviating from the causal coefficients can lead to (potentially unbounded) individual-level unfairness.


title: The Detailed Light Curve Evolution of V1674 Her (Nova Her 2021)

abstract: We report high-cadence photometry of the ultra-fast ($t_2\sim1.2$ d) nova V1674 Her during its rise to maximum light ($V\sim6.3$) and the beginning of its subsequent decline. These observations from Evryscope and the Mount Laguna Observatory All-Sky Camera reveal a plateau in the pre-maximum light curve at $g\sim14$ ($\sim$8 mag below peak) that lasted for at least three hours. Similar features (so-called pre-maximum halts) have been observed in some novae near maximum light, but to our knowledge the detection of a plateau in the light curve $\sim$8 mag below peak is unprecedented.


title: Theory of plasmonic edge states in chiral bilayer systems

abstract: We analytically describe the plasmonic edge modes for an interface that involves the twisted bilayer graphene (TBG) or other similar Moire van der Waals heterostructure. For this purpose, we employ a spatially homogeneous, isotropic and frequency-dependent tensor conductivity which in principle accounts for electronic and electrostatic interlayer couplings. We predict that the edge mode dispersion relation explicitly depends on the chiral response even in the nonretarded limit, in contrast to the collective bulk plasmonic excitations in the TBG. We obtain a universal function for the dispersion of the optical edge plasmon in the paramagnetic regime. This implies a correspondence of the chiral-TBG optical plasmon to a magnetoplasmon of a single sheet, and chirality is interpreted as an effective magnetic field. The chirality also opens up the possibility of nearly undamped acoustic modes in the paramagnetic regime. Our results may guide future near-field nanoscopy for van der Waals heterostructures. In our analysis, we retain the long-range electrostatic interaction, and apply the Wiener-Hopf method to a system of integral equations for the scalar potentials of the two layers.


title: Adaptive Algorithms for Relatively Lipschitz Continuous Convex Optimization Problems

abstract: Recently there were proposed some innovative convex optimization concepts, namely, relative smoothness [1] and relative strong convexity [2,3]. These approaches have significantly expanded the class of applicability of gradient-type methods with optimal estimates of the convergence rate, which are invariant regardless of the dimensionality of the problem. Later Yu. Nesterov and H. Lu introduced some modifications of the Mirror Descent method for convex minimization problems with the corresponding analogue of the Lipschitz condition (so-called relative Lipschitz continuity). By introducing an artificial inaccuracy to the optimization model, we propose adaptive methods for minimizing a convex Lipschitz continuous function, as well as for the corresponding class of variational inequalities. We also consider an adaptive "universal" method, applicable to convex minimization problems both on the class of relatively smooth and relatively Lipschitz continuous functionals with optimal estimates of the convergence rate. The universality of the method makes it possible to justify the applicability of the obtained theoretical results to a wider class of convex optimization problems. We also present the results of numerical experiments.


title: Likelihood estimation of sparse topic distributions in topic models and its applications to Wasserstein document distance calculations

abstract: This paper studies the estimation of high-dimensional, discrete, possibly sparse, mixture models in topic models. The data consists of observed multinomial counts of $p$ words across $n$ independent documents. In topic models, the $p\times n$ expected word frequency matrix is assumed to be factorized as a $p\times K$ word-topic matrix $A$ and a $K\times n$ topic-document matrix $T$. Since columns of both matrices represent conditional probabilities belonging to probability simplices, columns of $A$ are viewed as $p$-dimensional mixture components that are common to all documents while columns of $T$ are viewed as the $K$-dimensional mixture weights that are document specific and are allowed to be sparse. The main interest is to provide sharp, finite sample, $\ell_1$-norm convergence rates for estimators of the mixture weights $T$ when $A$ is either known or unknown. For known $A$, we suggest MLE estimation of $T$. Our non-standard analysis of the MLE not only establishes its $\ell_1$ convergence rate, but reveals a remarkable property: the MLE, with no extra regularization, can be exactly sparse and contain the true zero pattern of $T$. We further show that the MLE is both minimax optimal and adaptive to the unknown sparsity in a large class of sparse topic distributions. When $A$ is unknown, we estimate $T$ by optimizing the likelihood function corresponding to a plug in, generic, estimator $\hat{A}$ of $A$. For any estimator $\hat{A}$ that satisfies carefully detailed conditions for proximity to $A$, the resulting estimator of $T$ is shown to retain the properties established for the MLE. The ambient dimensions $K$ and $p$ are allowed to grow with the sample sizes. Our application is to the estimation of 1-Wasserstein distances between document generating distributions. We propose, estimate and analyze new 1-Wasserstein distances between two probabilistic document representations.


title: Effects of personality traits in predicting grade retention of Brazilian students

abstract: Student's grade retention is a key issue faced by many education systems, especially those in developing countries. In this paper, we seek to gauge the relevance of students' personality traits in predicting grade retention in Brazil. For that, we used data collected in 2012 and 2017, in the city of Sertaozinho, countryside of the state of Sao Paulo, Brazil. The surveys taken in Sertaozinho included several socioeconomic questions, standardized tests, and a personality test. Moreover, students were in grades 4, 5, and 6 in 2012. Our approach was based on training machine learning models on the surveys' data to predict grade retention between 2012 and 2017 using information from 2012 or before, and then using some strategies to quantify personality traits' predictive power. We concluded that, besides proving to be fairly better than a random classifier when isolated, personality traits contribute to prediction even when using socioeconomic variables and standardized tests results.


title: Combiner: Full Attention Transformer with Sparse Computation Cost

abstract: Transformers provide a class of expressive architectures that are extremely effective for sequence modeling. However, the key limitation of transformers is their quadratic memory and time complexity $\mathcal{O}(L^2)$ with respect to the sequence length in attention layers, which restricts application in extremely long sequences. Most existing approaches leverage sparsity or low-rank assumptions in the attention matrix to reduce cost, but sacrifice expressiveness. Instead, we propose Combiner, which provides full attention capability in each attention head while maintaining low computation and memory complexity. The key idea is to treat the self-attention mechanism as a conditional expectation over embeddings at each location, and approximate the conditional distribution with a structured factorization. Each location can attend to all other locations, either via direct attention, or through indirect attention to abstractions, which are again conditional expectations of embeddings from corresponding local regions. We show that most sparse attention patterns used in existing sparse transformers are able to inspire the design of such factorization for full attention, resulting in the same sub-quadratic cost ($\mathcal{O}(L\log(L))$ or $\mathcal{O}(L\sqrt{L})$). Combiner is a drop-in replacement for attention layers in existing transformers and can be easily implemented in common frameworks. An experimental evaluation on both autoregressive and bidirectional sequence tasks demonstrates the effectiveness of this approach, yielding state-of-the-art results on several image and text modeling tasks.


title: Peabodies of Constant Width

abstract: The purpose of this paper is to describe a new $3$-dimensional family of bodies of constant width that we have called peabodies, obtained from the Reuleaux tetrahedron by replacing a small neighborhood of all six edges with sections of an envelope of spheres. This family contains, in particular, the two Meissner solids and a body with tetrahedral symmetry that we have called Robert's body. Behind the construction of this family lies the classical notion of confocal quadrics discussed, for example, by Hilbert in his famous book. We study confocal quadrics and prove that the distances of an alternating sequence of four points in two confocal quadrics always satisfies a simple equation and use this equation to prove that our bodies have constant width.


title: A conservative and energy stable discontinuous spectral element method for the shifted wave equation in second order form

abstract: In this paper, we develop a provably energy stable and conservative discontinuous spectral element method for the shifted wave equation in second order form. The proposed method combines the advantages and central ideas of very successful numerical techniques, the summation-by-parts finite difference method, the spectral method and the discontinuous Galerkin method. We prove energy-stability, discrete conservation principle, and derive error estimates in the energy norm for the (1+1)-dimensions shifted wave equation in second order form. The energy-stability results, discrete conservation principle, and the error estimates generalise to multiple dimensions using tensor products of quadrilateral and hexahedral elements. Numerical experiments, in (1+1)-dimensions and (2+1)-dimensions, verify the theoretical results and demonstrate optimal convergence of $L^2$ numerical errors at subsonic, sonic and supersonic regimes.


title: Deep learning reconstruction of the large scale structure of the Universe from luminosity distance observations

abstract: Supernovae Ia (SNe) can provide a unique window on the large scale structure (LSS) of the Universe at redshifts where few other observations are available, by solving the inversion problem (IP) consisting in reconstructing the LSS from its effects on the observed luminosity distance. So far the IP was solved assuming some restrictions about space-time, such as spherical symmetry for example, while we obtain for the first time solutions of the IP problem for arbitrary space-time geometries using deep learning. The method is based on the use of convolutional neural networks (CNN) trained on simulated data. The training data set is obtained by first generating random density and velocity fields, and then computing their effects on the luminosity distance. The CNN, based on an appriately modified version of U-Net to account for the tridimensionality of the data, is then trained to reconstruct the density and velocity fields from the luminosity distance. We find that the velocity field inversion is more accurate than the density field, because the effects of the velocity on the luminosity distance only depend on the source velocity, while in the case of the density it is an integrated effect along the line of sight, giving rise to more degeneracy in the solution of the IP. Improved versions of these neural networks, modified to accommodate the non uniform distribution of the SNe, can be applied to observational data to reconstruct the large scale structure of the Universe at redshifts at which few other observations are available.