title: The FHI-aims Code: All-electron, ab initio materials simulations towards the exascale

abstract: FHI-aims is a quantum mechanics software package based on numeric atom-centered orbitals (NAOs) with broad capabilities for all-electron electronic-structure calculations and ab initio molecular dynamics. It also connects to workflows for multi-scale and artificial intelligence modeling.


title: Generalized-alpha scheme in the PFEM for velocity-pressure and displacement-pressure formulations of the incompressible Navier-Stokes equations

abstract: Despite the increasing use of the Particle Finite Element Method (PFEM) in fluid flow simulation and the outstanding success of the Generalized-alpha time integration method, very little discussion has been devoted to their combined performance. This work aims to contribute in this regard by addressing three main aspects. Firstly, it includes a detailed implementation analysis of the Generalized-alpha method in PFEM. The work recognizes and compares different implementation approaches from the literature, which differ mainly in the terms that are alpha-interpolated (state variables or forces of momentum equation) and the type of treatment for the pressure in the time integration scheme. Secondly, the work compares the performance of the Generalized-alpha method against the Backward Euler and Newmark schemes for the solution of the incompressible Navier-Stokes equations. Thirdly, the study is enriched by considering not only the classical velocity-pressure formulation but also the displacement-pressure formulation that is gaining interest in the fluid-structure interaction field. The work is carried out using various 2D and 3D benchmark problems such as the fluid sloshing, the solitary wave propagation, the flow around a cylinder, and the collapse of a cylindrical water column.


title: Multibubble blow-up analysis for the Brezis-Nirenberg problem in three dimensions

abstract: For a smooth bounded domain $\Omega \subset \mathbb R^3$ and smooth functions $a$ and $V$, we consider the asymptotic behavior of a sequence of positive solutions $u_\epsilon$ to $-\Delta u_\epsilon + (a+\epsilon V) u_\epsilon = u_\epsilon^5$ on $\Omega$ with zero Dirichlet boundary conditions, which blow up as $\epsilon \to 0$. We derive the sharp blow-up rate and characterize the location of concentration points in the general case of multiple blow-up, thereby obtaining a complete picture of blow-up phenomena in the framework of the Brezis-Peletier conjecture in dimension $N=3$.


title: Identifying glitches near gravitational-wave signals from compact binary coalescences using the Q-transform

abstract: We present a computational method to identify glitches in gravitational-wave data that occur nearby gravitational-wave signals from compact binary coalescences. The Q-transform, an established tool in LIGO-Virgo-KAGRA data analysis, computes the probability of any excess in the data surrounding a signal against the assumption of a Gaussian noise background, flagging any significant glitches. Subsequently, we perform validation tests on this computational method to ensure self-consistency in colored Gaussian noise, as well as data that contains a gravitational-wave event after subtracting the signal using the best-fit template. Finally, a comparison of our glitch identification results from real events in LIGO-Virgo's third observing run against the list of events which required glitch mitigation shows that this tool will be useful in providing precise information about data quality to improve astrophysical analyses of these events.


title: LinCQA: Faster Consistent Query Answering with Linear Time Guarantees

abstract: Most data analytical pipelines often encounter the problem of querying inconsistent data that violate pre-determined integrity constraints. Data cleaning is an extensively studied paradigm that singles out a consistent repair of the inconsistent data. Consistent query answering (CQA) is an alternative approach to data cleaning that asks for all tuples guaranteed to be returned by a given query on all (in most cases, exponentially many) repairs of the inconsistent data. This paper identifies a class of acyclic select-project-join (SPJ) queries for which CQA can be solved via SQL rewriting with a linear time guarantee. Our rewriting method can be viewed as a generalization of Yannakakis's algorithm for acyclic joins to the inconsistent setting. We present LinCQA, a system that can output rewritings in both SQL and non-recursive Datalog rules for every query in this class. We show that LinCQA often outperforms the existing CQA systems on both synthetic and real-world workloads, and in some cases, by orders of magnitude.


title: Image Reconstruction by Splitting Expectation Propagation Techniques from Iterative Inversion

abstract: Reconstructing images from downsampled and noisy measurements, such as MRI and low dose Computed Tomography (CT), is a mathematically ill-posed inverse problem. We propose an easy-to-use reconstruction method based on Expectation Propagation (EP) techniques. We incorporate the Monte Carlo (MC) method, Markov Chain Monte Carlo (MCMC), and Alternating Direction Method of Multiplier (ADMM) algorithm into EP method to address the intractability issue encountered in EP. We demonstrate the approach on complex Bayesian models for image reconstruction. Our technique is applied to images from Gamma-camera scans. We compare EPMC, EP-MCMC, EP-ADMM methods with MCMC only. The metrics are the better image reconstruction, speed, and parameters estimation. Experiments with Gamma-camera imaging in real and simulated data show that our proposed method is convincingly less computationally expensive than MCMC and produces relatively a better image reconstruction.


title: Variance Reduction based Experience Replay for Policy Optimization

abstract: For reinforcement learning on complex stochastic systems where many factors dynamically impact the output trajectories, it is desirable to effectively leverage the information from historical samples collected in previous iterations to accelerate policy optimization. Classical experience replay allows agents to remember by reusing historical observations. However, the uniform reuse strategy that treats all observations equally overlooks the relative importance of different samples. To overcome this limitation, we propose a general variance reduction based experience replay (VRER) framework that can selectively reuse the most relevant samples to improve policy gradient estimation. This selective mechanism can adaptively put more weight on past samples that are more likely to be generated by the current target distribution. Our theoretical and empirical studies show that the proposed VRER can accelerate the learning of optimal policy and enhance the performance of state-of-the-art policy optimization approaches.


title: Adiabatic Focusing of a Long Proton Bunch in Plasma

abstract: We show in experiments that a long, relativistic proton bunch is focused by the plasma adiabatic response. The free plasma electrons migrate so as to neutralize the space charge field of the bunch, and the bunch is therefore focused by the azimuthal magnetic field generated by its own current, that is not balanced by the radial electric field. Since the length of the bunch is much longer than the plasma electron wavelength, the bunch also undergoes the self-modulation instability. Thus, the amplitude of the wakefields grows along the bunch and along the plasma, and the defocusing effect of the self-modulation can become dominant over the adiabatic focusing effect. We show that, when seeding the self-modulation with a preceding electron bunch, the transition between the effect of the adiabatic response and that of the self-modulation depends on the amplitude of the seed wakefields.


title: Bokeh-Loss GAN: Multi-Stage Adversarial Training for Realistic Edge-Aware Bokeh

abstract: In this paper, we tackle the problem of monocular bokeh synthesis, where we attempt to render a shallow depth of field image from a single all-in-focus image. Unlike in DSLR cameras, this effect can not be captured directly in mobile cameras due to the physical constraints of the mobile aperture. We thus propose a network-based approach that is capable of rendering realistic monocular bokeh from single image inputs. To do this, we introduce three new edge-aware Bokeh Losses based on a predicted monocular depth map, that sharpens the foreground edges while blurring the background. This model is then finetuned using an adversarial loss to generate a realistic Bokeh effect. Experimental results show that our approach is capable of generating a pleasing, natural Bokeh effect with sharp edges while handling complicated scenes.


title: Two-level Closed Loops for RAN Slice Resources Management Serving Flying and Ground-based Cars

abstract: Flying and ground-based cars require various services such as autonomous driving, remote pilot, infotainment, and remote diagnosis. Each service requires specific Quality of Service (QoS) and network features. Therefore, network slicing can be a solution to fulfill the requirements of various services. Some services, such as infotainment, may have similar requirements to serve flying and ground-based cars. Therefore, some slices can serve both kinds of cars. However, when network slice resource sharing is too aggressive, slices can not meet QoS requirements, where resource under-provisioning causes the violation of QoS, and resource over-provisioning causes resource under-utilization. We propose two closed loops for managing RAN slice resources for cars to address these challenges. First, we present an auction mechanism for allocating Resource Block (RB) to the tenants who provide services to the cars using slices. Second, we design one closed loop that maps slices and services of tenants to virtual Open Distributed Units (vO-DUs) and assigns RB to vO-DUs for management purposes. Third, we design another closed loop for intra-slices RB scheduling to serve cars. Fourth, we present a reward function that interconnects these two closed loops to satisfy the time-varying demands of cars at each slice while meeting QoS requirements in terms of delay. Finally, we design distributed deep reinforcement learning approach to maximize the formulated reward function. The simulation results show that our approach satisfies more than 90% vO-DUs resource constraints and network slice requirements.


title: Light-weight probing of unsupervised representations for Reinforcement Learning

abstract: Unsupervised visual representation learning offers the opportunity to leverage large corpora of unlabeled trajectories to form useful visual representations, which can benefit the training of reinforcement learning (RL) algorithms. However, evaluating the fitness of such representations requires training RL algorithms which is computationally intensive and has high variance outcomes. Inspired by the vision community, we study whether linear probing can be a proxy evaluation task for the quality of unsupervised RL representation. Specifically, we probe for the observed reward in a given state and the action of an expert in a given state, both of which are generally applicable to many RL domains. Through rigorous experimentation, we show that the probing tasks are strongly rank correlated with the downstream RL performance on the Atari100k Benchmark, while having lower variance and up to 600x lower computational cost. This provides a more efficient method for exploring the space of pretraining algorithms and identifying promising pretraining recipes without the need to run RL evaluations for every setting. Leveraging this framework, we further improve existing self-supervised learning (SSL) recipes for RL, highlighting the importance of the forward model, the size of the visual backbone, and the precise formulation of the unsupervised objective.


title: Subjective data models in bioinformatics: Do wet-lab and computational biologists comprehend data differently?

abstract: Biological science produces large amounts of data in a variety of formats, which necessitates the use of computational tools to process, integrate, analyse, and glean insights from the data. Researchers who use computational biology tools range from those who use computers primarily for communication and data lookup, to those who write complex software programs in order to analyse data or make it easier for others to do so. This research examines how people differ in how they conceptualise the same data, for which we coin the term "subjective data models". We interviewed 22 people with biological experience and varied levels of computational experience to elicit their perceptions of the same subset of biological data entities. The results suggest that many people had fluid subjective data models that would change depending on the circumstance or tool they were using. Surprisingly, results generally did not seem to cluster around a participant's computational experience/education levels, or the lack thereof. We further found that people did not consistently map entities from an abstract data model to the same identifiers in real-world files, and found that certain data identifier formats were easier for participants to infer meaning from than others. Real-world implications of these findings suggests that 1) software engineers should design interfaces for task performance and emulate other related popular user interfaces, rather than targeting a person's professional background; 2) when insufficient context is provided, people may guess what data means, whether or not their guesses are correct, emphasising the importance of providing contextual metadata when preparing data for re-use by other, to remove the need for potentially erroneous guesswork.


title: Robustness, Scott Continuity, and Computability

abstract: Robustness is a property of system analyses, namely monotonic maps from the complete lattice of subsets of a (system's state) space to the two-point lattice. The definition of robustness requires the space to be a metric space. Robust analyses cannot discriminate between a subset of the metric space and its closure, therefore one can restrict to the complete lattice of closed subsets. When the metric space is compact, the complete lattice of closed subsets ordered by reverse inclusion is w-continuous and robust analyses are exactly the Scott continuous maps. Thus, one can also ask whether a robust analysis is computable (with respect to a countable base). The main result of this paper establishes a relation between robustness and Scott continuity, when the metric space is not compact. The key idea is to replace the metric space with a compact Hausdorff space, and relate robustness and Scott continuity by an adjunction between the complete lattice of closed subsets of the metric space and the w-continuous lattice of closed subsets of the compact Hausdorff space. We demonstrate the applicability of this result with several examples involving Banach spaces.


title: SNAP: Efficient Extraction of Private Properties with Poisoning

abstract: Property inference attacks allow an adversary to extract global properties of the training dataset from a machine learning model. Such attacks have privacy implications for data owners sharing their datasets to train machine learning models. Several existing approaches for property inference attacks against deep neural networks have been proposed, but they all rely on the attacker training a large number of shadow models, which induces a large computational overhead. In this paper, we consider the setting of property inference attacks in which the attacker can poison a subset of the training dataset and query the trained target model. Motivated by our theoretical analysis of model confidences under poisoning, we design an efficient property inference attack, SNAP, which obtains higher attack success and requires lower amounts of poisoning than the state-of-the-art poisoning-based property inference attack by Mahloujifar et al. For example, on the Census dataset, SNAP achieves 34% higher success rate than Mahloujifar et al. while being 56.5x faster. We also extend our attack to infer whether a certain property was present at all during training and estimate the exact proportion of a property of interest efficiently. We evaluate our attack on several properties of varying proportions from four datasets and demonstrate SNAP's generality and effectiveness. An open-source implementation of SNAP can be found at https://github.com/johnmath/snap-sp23.


title: Snooping on Snoopers: Logging as a Security Response to Physical Attacks on Mobile Devices

abstract: When users leave their mobile devices unattended, or let others use them momentarily, they are susceptible to privacy breaches. Existing technological defenses, such as unlock authentication or account switching, have proven to be unpopular. We conducted interviews to uncover practices users currently engage in to cope with the threat, and found that it is common for users to try to keep their devices under close supervision at all times. One obstacle to this strategy is that displaying such protective behavior can be detrimental to social relationships. To address these concerns, we built a software tool that gathers activity logs in the background. Logs can later be reviewed as a timeline of opened apps and the actions performed within each, with events decorated with pictures captured inconspicuously with the front-facing camera. We evaluated this approach in a user study, and found participants to be generally eager to adopt the technology, although in different ways. Most users foresaw using it as a deterrent, or to check if they were snooped on, if that suspicion were ever to arise. Yet, some voiced the intention of creating "honey traps". The results highlight both the opportunities and the potential dangers of the logging approach.


title: Understanding the Power of Evolutionary Computation for GPU Code Optimization

abstract: Achieving high performance for GPU codes requires developers to have significant knowledge in parallel programming and GPU architectures, and in-depth understanding of the application. This combination makes it challenging to find performance optimizations for GPU-based applications, especially in scientific computing. This paper shows that significant speedups can be achieved on two quite different scientific workloads using the tool, GEVO, to improve performance over human-optimized GPU code. GEVO uses evolutionary computation to find code edits that improve the runtime of a multiple sequence alignment kernel and a SARS-CoV-2 simulation by 28.9% and 29% respectively. Further, when GEVO begins with an early, unoptimized version of the sequence alignment program, it finds an impressive 30 times speedup -- a performance improvement similar to that of the hand-tuned version. This work presents an in-depth analysis of the discovered optimizations, revealing that the primary sources of improvement vary across applications; that most of the optimizations generalize across GPU architectures; and that several of the most important optimizations involve significant code interdependencies. The results showcase the potential of automated program optimization tools to help reduce the optimization burden for scientific computing developers and enhance performance portability for domain-specific accelerators.


title: On the velocity of a small rigid body in a viscous incompressible fluid in dimension two and three

abstract: In this paper we study the evolution of a small rigid body in a viscous incompressible fluid, in particular we show that a small particle is not accelerated by the fluid in the limit when its size converges to zero under a lower bound on its mass. This result is based on a new a priori estimate on the velocities of the centers of mass of rigid bodies that holds in the case when their masses are also allowed to decrease to zero.


title: OOD-Probe: A Neural Interpretation of Out-of-Domain Generalization

abstract: The ability to generalize out-of-domain (OOD) is an important goal for deep neural network development, and researchers have proposed many high-performing OOD generalization methods from various foundations. While many OOD algorithms perform well in various scenarios, these systems are evaluated as ``black-boxes''. Instead, we propose a flexible framework that evaluates OOD systems with finer granularity using a probing module that predicts the originating domain from intermediate representations. We find that representations always encode some information about the domain. While the layerwise encoding patterns remain largely stable across different OOD algorithms, they vary across the datasets. For example, the information about rotation (on RotatedMNIST) is the most visible on the lower layers, while the information about style (on VLCS and PACS) is the most visible on the middle layers. In addition, the high probing results correlate to the domain generalization performances, leading to further directions in developing OOD generalization systems.


title: Wave functions of $(I,J^P) = (\tfrac{1}{2},\tfrac{3}{2}^\mp)$ baryons

abstract: Using a Poincar\'e-covariant quark+diquark Faddeev equation, we provide structural information on the four lightest $(I,J^P)=(\tfrac{1}{2},\tfrac{3}{2}^\mp)$ baryon multiplets. These systems may contain five distinct types of diquarks; but in order to obtain reliable results, it is sufficient to retain only isoscalar-scalar and isovector-axialvector correlations, with the latter being especially important. Viewed with low resolution, the Faddeev equation description of these states bears some resemblance to the associated quark model pictures; namely, they form a set of states related via orbital angular momentum excitation: the negative parity states are primarily $\mathsf P$-wave in character, whereas the positive parity states are $\mathsf D$ wave. However, a closer look reveals far greater structural complexity than is typical of quark model descriptions, with $\mathsf P$, $\mathsf D$, $\mathsf S$, $\mathsf F$ waves and interferences between them all playing a large role in forming observables. Large momentum transfer resonance electroexcitation measurements can be used to test these predictions and may thereby provide insights into the nature of emergent hadron mass.


title: Fundamentals of Task-Agnostic Data Valuation

abstract: We study valuing the data of a data owner/seller for a data seeker/buyer. Data valuation is often carried out for a specific task assuming a particular utility metric, such as test accuracy on a validation set, that may not exist in practice. In this work, we focus on task-agnostic data valuation without any validation requirements. The data buyer has access to a limited amount of data (which could be publicly available) and seeks more data samples from a data seller. We formulate the problem as estimating the differences in the statistical properties of the data at the seller with respect to the baseline data available at the buyer. We capture these statistical differences through second moment by measuring diversity and relevance of the seller's data for the buyer; we estimate these measures through queries to the seller without requesting raw data. We design the queries with the proposed approach so that the seller is blind to the buyer's raw data and has no knowledge to fabricate responses to queries to obtain a desired outcome of the diversity and relevance trade-off.We will show through extensive experiments on real tabular and image datasets that the proposed estimates capture the diversity and relevance of the seller's data for the buyer.


title: Minimal $\ell^2$ Norm Discrete Multiplier Method

abstract: We introduce an extension to the Discrete Multiplier Method (DMM), called Minimal $\ell_2$ Norm Discrete Multiplier Method (MN-DMM), where conservative finite difference schemes for dynamical systems with multiple conserved quantities are constructed procedurally, instead of analytically as in the original DMM. For large dynamical systems with multiple conserved quantities, MN-DMM alleviates difficulties that can arise with the original DMM at constructing conservative schemes which satisfies the discrete multiplier conditions. In particular, MN-DMM utilizes the right Moore-Penrose pseudoinverse of the discrete multiplier matrix to solve an underdetermined least-square problem associated with the discrete multiplier conditions. We prove consistency and conservative properties of the MN-DMM schemes. We also introduce two variants - Mixed MN-DMM and MN-DMM using Singular Value Decomposition - and discuss their usage in practice. Moreover, numerical examples on various problems arising from the mathematical sciences are shown to demonstrate the wide applicability of MN-DMM and its relative ease of implementation compared to the original DMM.


title: Lib-SibGMU -- A University Library Circulation Dataset for Recommender Systems Developmen

abstract: We opensource under CC BY 4.0 license Lib-SibGMU - a university library circulation dataset - for a wide research community, and benchmark major algorithms for recommender systems on this dataset. For a recommender architecture that consists of a vectorizer that turns the history of the books borrowed into a vector, and a neighborhood-based recommender, trained separately, we show that using the fastText model as a vectorizer delivers competitive results.


title: Block Preconditioners for the Marker-and-Cell Discretization of the Stokes-Darcy Equations

abstract: We consider the problem of iteratively solving large and sparse double saddle-point systems arising from the stationary Stokes-Darcy equations in two dimensions, discretized by the Marker-and-Cell (MAC) finite difference method. We analyze the eigenvalue distribution of a few ideal block preconditioners. We then derive practical preconditioners that are based on approximations of Schur complements that arise in a block decomposition of the double saddle-point matrix. We show that including the interface conditions in the preconditioners is key in the pursuit of scalability. Numerical results show good convergence behavior of our preconditioned GMRES solver and demonstrate robustness of the proposed preconditioner with respect to the physical parameters of the problem.


title: A degree theorem for the simplicial closure of Auter space

abstract: The degree of a based graph is the number of essential nonbasepoint vertices after generic perturbation. Hatcher--Vogtmann's degree theorem states that the subcomplex of Auter space of graphs of degree at most d is (d-1)-connected. We extend the definition of degree to the simplicial closure of Auter space and prove a version of Hatcher--Vogtmann's result in this context.


title: Social Diversity for ATL Repair

abstract: Model transformations play an essential role in the Model-Driven Engineering paradigm. Writing a correct transformation program requires to be proficient with the source and target modeling languages, to have a clear understanding of the mapping between the elements of the two, as well as to master the transformation language to properly describe the transformation. Transformation programs are thus complex and error-prone, and finding and fixing errors in such programs typically involve a tedious and time-consuming effort by developers. In this paper, we propose a novel search-based approach to automatically repair transformation programs containing many semantic errors. To prevent the fitness plateaus and the single fitness peak limitations, we leverage the notion of social diversity to promote repair patches tackling errors that are less covered by the other patches of the population. We evaluate our approach on 71 semantically incorrect transformation programs written in ATL, and containing up to five semantic errors simultaneously. The evaluation shows that integrating social diversity when searching for repair patches allows to improve the quality of those patches and to speed up the convergence even when up to five semantic errors are involved.


title: Lessons Learned from a Bare-metal Evaluation of Erasure Coding Algorithms in P2P Networks

abstract: We have built a bare-metal testbed in order to perform large-scale, reproducible evaluations of erasure coding algorithms. Our testbed supports at least 1000 Ethereum Swarm peers running on 30 machines. Running experimental evaluation is time-consuming and challenging. Researchers must consider the experimental software's limitations and artifacts. If not controlled, the network behavior may cause inaccurate measurements. This paper shares the lessons learned from a bare-metal evaluation of erasure coding algorithms and how to create a controlled-environment in a cluster consisting of 1000 Ethereum Swarm peers.


title: Using Atom-Like Local Image Features to Study Human Genetics and Neuroanatomy in Large Sets of 3D Medical Image Volumes

abstract: The contributions of this thesis stem from technology developed to analyse large sets of volumetric images in terms of atom-like features extracted in 3D image space, following SIFT algorithm in 2D image space. New feature properties are introduced including a binary feature sign, analogous to an electrical charge, and a discrete set of symmetric feature orientation states in 3D space. These new properties are leveraged to extend feature invariance to include the sign inversion and parity (SP) transform, analogous to the charge conjugation and parity (CP) transform between a particle and its antiparticle in quantum mechanics, thereby accounting for local intensity contrast inversion between imaging modalities and axis reflections due to shape symmetry. A novel exponential kernel is proposed to quantify the similarity of a pair of features extracted in different images from their properties including location, scale, orientation, sign and appearance. A novel measure entitled the soft Jaccard is proposed to quantify the similarity of a pair of feature sets based on their overlap or intersection-over-union, where a kernel establishes non-binary or soft equivalence between a pair of feature elements. The soft Jaccard may be used to identify pairs of feature sets extracted from the same individuals or families with high accuracy, and a simple distance threshold led to the surprising discovery of previously unknown individual and family labeling errors in major public neuroimage datasets. A new algorithm is proposed to register or spatially align a pair of feature sets, entitled SIFT Coherent Point Drift (SIFT-CPD), by identifying a transform that maximizes the soft Jaccard between a fixed feature set and a transformed set. SIFT-CPD achieves faster and more accurate registration than the original CPD algorithm based on feature location information alone, in a variety of challenging.


title: Laue and Fresnel lenses

abstract: The low-energy gamma-ray domain is an important window for the study of the high energy Universe. Here matter can be observed in extreme physical conditions and during powerful explosive events. However, observing gamma-rays from faint sources is extremely challenging with current instrumentation. With techniques used at present collecting more signal requires larger detectors, leading to an increase in instrumental background. For the leap in sensitivity that is required for future gamma-ray missions use must be made of flux concentrating telescopes. Fortunately, gamma-ray optics such as Laue or Fresnel lenses, based on diffraction, make this possible. Laue lenses work with moderate focal lengths (tens to a few hundreds of metres), but provide only rudimentary imaging capabilities. On the other hand, Fresnel lenses offer extremely good imaging, but with a very small field of view and a requirement for focal lengths $\sim$10$^8$ m. This chapter presents the basic concepts of these optics and describes their working principles, their main properties and some feasibility studies already conducted.


title: Applications of Diagrammatic Renormalization Methods in QCD Sum-Rules

abstract: In QCD sum-rule methods, the fundamental field-theoretical quantities are correlation functions of composite operators that serve as hadronic interpolating fields. One of the challenges of loop corrections to QCD correlation functions in conventional approaches is the renormalization-induced mixing of composite operators. This involves a multi-step process of first renormalizing the operators, and then calculating the correlation functions in this mixed basis. This process becomes increasingly complicated as the number of operators mixed under renormalization increases, a situation that is exacerbated as the operator mass dimension increases in important physical systems such as tetraquarks, pentaquarks, and hybrids. Diagrammatic renormalization provides an alternative to the conventional operator renormalization approach. Diagrammatic renormalization methods are outlined and applied to a variety of QCD sum-rule examples of increasing complexity. The results are benchmarked, and the diagrammatic method is contrasted with the conventional operator mixing approach. Advantages and conceptual interpretations of the diagrammatic renormalization approach are outlined and technical subtleties are explored.


title: Chasing Tails: Active Asteroid, Centaur, and Quasi-Hilda Discovery with Astroinformatics and Citizen Science

abstract: The 1950 discovery of activity emanating from asteroid (4015) Wilson-Harrington prompted astronomers to realize comet-like activity is not limited to comets. Since then < 30 active asteroids have been discovered, yet they hold clues about fundamental physical and chemical processes in the solar system. Around half of the activity is attributed to sublimation, highlighting asteroids as a "volatile reservoir" - a dynamical group of minor planets that harbor volatiles. Centaurs, found between the orbits of Jupiter and Neptune, were first recognized in 1977 and represent another reservoir. Active Centaurs are also rare, with < 20 known. Understanding the solar system volatile distribution has broad implications, from informing space exploration programs to illuminating how planetary systems form with volatiles prerequisite to life as we know it. We set out to increase the number of known active objects to enable their study as populations. In this dissertation I present (1) our pipeline that extracts images of known minor planets for presentation to Citizen Scientists, (2) our proof-of-concept demonstrating Dark Energy Camera images are ideal for activity detection (Chandler et al. 2018), (3) how we identified a potential new recurrent activity mechanism (Chandler et al. 2019), (4) a Centaur activity discovery, plus a novel technique to estimate which species are sublimating (Chandler et al. 2020), (5) how our project enabled us to classify an object as a member of the main-belt comets (Chandler et al. 2021), a rare (<10) active asteroid subset known for sublimation-driven activity, (6) the identification of a Quasi-Hilda comet and a dynamical pathway that may explain the presence of some active asteroids (Chandler et al. 2022), and (7) our NASA Partner Citizen Science project Active Asteroids (http://activeasteroids.net), including initial results.


title: The Astrodust+PAH Model: A Unified Description of the Extinction, Emission, and Polarization from Dust in the Diffuse Interstellar Medium

abstract: We present a new model of interstellar dust in which large grains are a single composite material, ``astrodust,'' and nanoparticle-sized grains come in distinct varieties including polycyclic aromatic hydrocarbons (PAHs). We argue that a single-composition model for grains larger than $\sim$0.02 $\mu$m most naturally explains the lack of frequency dependence in the far-infrared (FIR) polarization fraction and the characteristic ratio of optical to FIR polarization. We derive a size distribution and alignment function for 1.4:1 oblate astrodust grains that, with PAHs, reproduce the mean wavelength dependence and polarization of Galactic extinction and emission from the diffuse interstellar medium while respecting constraints on solid phase abundances. All model data and Python-based interfaces are made publicly available.


title: VEViD: Vision Enhancement via Virtual diffraction and coherent Detection

abstract: The history of computing started with analog computers consisting of physical devices performing specialized functions such as predicting the trajectory of cannon balls. In modern times, this idea has been extended, for example, to ultrafast nonlinear optics serving as a surrogate analog computer to probe the behavior of complex phenomena such as rogue waves. Here we discuss a new paradigm where physical phenomena coded as an algorithm perform computational imaging tasks. Specifically, diffraction followed by coherent detection, not in its analog realization but when coded as an algorithm, becomes an image enhancement tool. Vision Enhancement via Virtual diffraction and coherent Detection (VEViD) introduced here reimagines a digital image as a spatially varying metaphoric light field and then subjects the field to the physical processes akin to diffraction and coherent detection. The term "Virtual" captures the deviation from the physical world. The light field is pixelated and the propagation imparts a phase with an arbitrary dependence on frequency which can be different from the quadratic behavior of physical diffraction. Temporal frequencies exist in three bands corresponding to the RGB color channels of a digital image. The phase of the output, not the intensity, represents the output image. VEViD is a high-performance low-light-level and color enhancement tool that emerges from this paradigm. The algorithm is interpretable and computationally efficient. We demonstrate image enhancement of 4k video at 200frames per second and show the utility of this physical algorithm in improving the accuracy of object detection by neural networks without having to retrain model for low-light conditions. The application of VEViD to color enhancement is also demonstrated.


title: A Compact Pretraining Approach for Neural Language Models

abstract: Domain adaptation for large neural language models (NLMs) is coupled with massive amounts of unstructured data in the pretraining phase. In this study, however, we show that pretrained NLMs learn in-domain information more effectively and faster from a compact subset of the data that focuses on the key information in the domain. We construct these compact subsets from the unstructured data using a combination of abstractive summaries and extractive keywords. In particular, we rely on BART to generate abstractive summaries, and KeyBERT to extract keywords from these summaries (or the original unstructured text directly). We evaluate our approach using six different settings: three datasets combined with two distinct NLMs. Our results reveal that the task-specific classifiers trained on top of NLMs pretrained using our method outperform methods based on traditional pretraining, i.e., random masking on the entire data, as well as methods without pretraining. Further, we show that our strategy reduces pretraining time by up to five times compared to vanilla pretraining. The code for all of our experiments is publicly available at https://github.com/shahriargolchin/compact-pretraining.


title: RF Accelerator Technology R&D: Report of AF7-rf Topical Group to Snowmass 2021

abstract: Accelerator radio frequency (RF) technology has been and remains critical for modern high energy physics (HEP) experiments based on particle accelerators. Tremendous progress in advancing this technology has been achieved over the past decade in several areas highlighted in this report. These achievements and new results expected from continued R&D efforts could pave the way for upgrades of existing facilities, improvements to accelerators already under construction (e.g., PIP-II), well-developed proposals (e.g., ILC, CLIC), and/or enable concepts under development, such as FCC-ee, CEPC, C3, HELEN, multi-MW Fermilab Proton Intensity Upgrade, future Muon Colloder, etc. Advances in RF technology have impact beyond HEP on accelerators built for nuclear physics, basic energy sciences, and other areas. Recent examples of such accelerators are European XFEL, LCLS-II and LCLS-II-HE, SHINE, SNS, ESS, FRIB, and EIC. To support and enable new accelerator-based applications and even make some of them feasible, we must continue addressing their challenges via a comprehensive RF R&D program that would advance the existing RF technologies and explore the nascent ones.


title: Pinch points and half-moons in dipolar-octupolar Nd$_2$Hf$_2$O$_7$

abstract: While it is established that the pinch point scattering pattern in spin ice arises from an emergent coulomb phase associated with magnetic moment that is divergence-free, more complex Hamiltonians can introduce a divergence-full part. If these two parts remain decoupled, they give rise to the co-existence of distinct features. Here we show that the moment in ${\rm Nd_2Hf_2O_7}$ forms a static long-range ordered ground state, a flat, gapped pinch point excitation and dispersive excitations. These results confirm recent theories which predict that the dispersive modes, which arise from the divergence-full moment, host a pinch point pattern of their own, observed experimentally as `half-moons'.


title: COOKIEGRAPH: Understanding and Detecting First-Party Tracking Cookies

abstract: As third-party cookie blocking is becoming the norm in browsers, advertisers and trackers have started to use first-party cookies for tracking. We conduct a differential measurement study on 10K websites with third-party cookies allowed and blocked. This study reveals that first-party cookies are used to store and exfiltrate identifiers to known trackers even when third-party cookies are blocked. As opposed to third-party cookie blocking, outright first-party cookie blocking is not practical because it would result in major functionality breakage. We propose CookieGraph, a machine learning-based approach that can accurately and robustly detect first-party tracking cookies. CookieGraph detects first-party tracking cookies with 90.20% accuracy, outperforming the state-of-the-art CookieBlock approach by 17.75%. We show that CookieGraph is fully robust against cookie name manipulation while CookieBlock's acuracy drops by 15.68%. While blocking all first-party cookies results in major breakage on 32% of the sites with SSO logins, and CookieBlock reduces it to 10%, we show that CookieGraph does not cause any major breakage on these sites. Our deployment of CookieGraph shows that first-party tracking cookies are used on 93.43% of the 10K websites. We also find that first-party tracking cookies are set by fingerprinting scripts. The most prevalent first-party tracking cookies are set by major advertising entities such as Google, Facebook, and TikTok.


title: Exploring the Correlation between $\rm{H}\alpha$-to-UV Ratio and Burstiness for Typical Star-forming Galaxies at $z\sim2$

abstract: The $\rm{H}\alpha$-to-UV luminosity ratio ($L(\rm H\alpha)/L(\rm UV)$) is often used to probe SFHs of star-forming galaxies and it is important to validate it against other proxies for burstiness. To address this issue, we present a statistical analysis of the resolved distribution of $\Sigma_{\rm{SFR}}$ as well as stellar age and their correlations with the globally measured $L(\rm H\alpha)/L(\rm UV)$ for a sample of 310 star-forming galaxies in two redshift bins of $1.37 < z < 1.70$ and $ 2.09 < z < 2.61$ observed by the MOSDEF survey. We use the multi-waveband CANDELS/3D-HST imaging of MOSDEF galaxies to construct $\Sigma_{\rm{SFR}}$ and stellar age maps. We analyze the composite rest-frame far-UV spectra of a subsample of MOSDEF targets obtained by the Keck/LRIS, which includes 124 star-forming galaxies (MOSDEF-LRIS) at redshifts $1.4 < z < 2.6$, to examine the average stellar population properties, and the strength of age-sensitive FUV spectral features in bins of $L(\rm H\alpha)/L(\rm UV)$. Our results show no significant evidence that individual galaxies with higher $L(\rm H\alpha)/L(\rm UV)$ are undergoing a burst of star formation based on the resolved distribution of $\Sigma_{\rm{SFR}}$ of individual star-forming galaxies. We segregate the sample into subsets with low and high $L(\rm H\alpha)/L(\rm UV)$. The high-$L(\rm H\alpha)/L(\rm UV)$ subset exhibits, on average, an age of $\log[\rm{Age/yr}]$ = 8.0, compared to $\log[\rm{Age/yr}]$ = 8.4 for the low-$L(\rm H\alpha)/L(\rm UV)$ galaxies, though the difference in age is significant at only the $2\sigma$ level. Furthermore, we find no variation in the strengths of Siiv$\lambda\lambda1393, 1402$ and Civ$\lambda\lambda1548, 1550$ P-Cygni features from massive stars between the two subsamples.


title: On the consistency of score sheets of a round-robin football tournament

abstract: In this paper we introduce the submonoids $\mathscr{R}_n$, resp. $\mathscr{C}_n$, of the monoid $\mathscr{M}_n$ of ordered score sheets of a robin-round tournament played by $n$ teams for which the order is preserved after the leader team is disqualified, resp. all principal submatrices preserve the given ordering. We study (using both theoretical and computational methods) the most important invariants of these monoids, namely the Hilbert basis, the multiplicity, the Hilbert series and the Hilbert function. In particular we give a general description of the Hilbert basis of $\mathscr{R}_n$ and we show that $\mathscr{C}_n$ is Gorenstein for $n>2$.


title: Collective phototactic robotectonics

abstract: Cooperative task execution, a hallmark of eusociality, is enabled by local interactions between the agents and the environment through a dynamically evolving communication signal. Inspired by the collective behavior of social insects whose dynamics is modulated by interactions with the environment, we show that a robot collective can successfully nucleate a construction site via a trapping instability and cooperatively build organized structures. The same robot collective can also perform de-construction with a simple change in the behavioral parameter. These behaviors belong to a two-dimensional phase space of cooperative behaviors defined by agent-agent interaction (cooperation) along one axis and the agent-environment interaction (collection and deposition) on the other. Our behavior-based approach to robot design combined with a principled derivation of local rules enables the collective to solve tasks with robustness to a dynamically changing environment and a wealth of complex behaviors.


title: Impact of the coagulation of dust particles on Mars during the 2018 global dust storm

abstract: Coagulation of particles occurs when two particles collide and stick together. In the Martian atmosphere, dust coagulation would increase the effective particle size, as small particles accrete to larger particles. Murphy et al. (1990) showed that Brownian coagulation of dust in the Martian atmosphere was not significant, due to the low dust particle mixing ratios, while Montmessin et al. (2002) and Fedorova et al. (2014) showed that it mostly involves particle radii smaller than 0.1 um. However, the effects of coagulation have never been explored in 3D, during a global dust storm, i.e. in presence of larger numbers of small particles. Here we revisit this issue by using the NASA Ames Mars Global Climate Model (MGCM) to investigate the temporal and spatial changes in dust particle sizes during the 2018 global storm due to coagulation and the overall impact of these processes on Mars' climate. Our parameterization for coagulation includes the effect of Brownian motion, Brownian diffusion enhancement, and gravitational collection. We show that Brownian motion and Brownian diffusion enhancement dominate gravitational collection. The impact of coagulation is significant during the storm, with coagulation rates increased by a factor of 10 compared to non-storm conditions. The effective particle radius can be increased by a factor of 2 due to coagulation, leading to a 20K colder atmosphere above 30 km altitude. Overall, our parameterization improves the representation of the decay phase of the storm relative to observations. The process remains significant outside the storm period if large numbers of submicron-sized particles are involved. It may be possible, in GCMs, to lift larger amounts of submicron-sized particles from the surface without excess dust buildup in the atmosphere, thus improving the agreement with some of the observations without diverging from the observed column opacities.


title: Totally non-negativity of a family of change-of-basis matrices

abstract: Let ${\bf a}=(a_1, a_2, \ldots, a_n)$ and ${\bf e}=(e_1, e_2, \ldots, e_n)$ be real sequences. Denote by $M_{{\bf e}\rightarrow {\bf a}}$ the $(n+1)\times(n+1)$ matrix whose $(m,k)$ entry ($m, k \in \{0,\ldots, n\}$) is the coefficient of the polynomial $(x-a_1)\cdots(x-a_k)$ in the expansion of $(x-e_1)\cdots(x-e_m)$ as a linear combination of the polynomials $1, x-a_1, \ldots, (x-a_1)\cdots(x-a_m)$. By appropriate choice of ${\bf a}$ and ${\bf e}$ the matrix $M_{{\bf e}\rightarrow {\bf a}}$ can encode many familiar doubly-indexed combinatorial sequences, such as binomial coefficients, Stirling numbers of both kinds, Lah numbers and central factorial numbers. In all four of these examples, $M_{{\bf e}\rightarrow {\bf a}}$ enjoys the property of total non-negativity -- the determinants of all its square submatrices are non-negative. This leads to a natural question: when, in general, is $M_{{\bf e}\rightarrow {\bf a}}$ totally non-negative? Galvin and Pacurar found a simple condition on ${\bf e}$ that characterizes total non-negativity of $M_{{\bf e}\rightarrow {\bf a}}$ when ${\bf a}$ is non-decreasing. Here we fully extend this result. For arbitrary real sequences ${\bf a}$ and ${\bf e}$, we give a condition that can be checked in $O(n^2)$ time that determines whether $M_{{\bf e}\rightarrow {\bf a}}$ is totally non-negative. When $M_{{\bf e}\rightarrow {\bf a}}$ is totally non-negative, we witness this with a planar network whose weights are non-negative and whose path matrix is $M_{{\bf e}\rightarrow {\bf a}}$. When it is not, we witness this with an explicit negative minor.


title: On the Spread of Entanglement at Finite Cutoff

abstract: We study how entanglement spreads in the boundary duals of finite-cutoff three-dimensional theories with positive, negative and zero cosmological constant, the $T \bar{T} + \Lambda_{2}$ two-dimensional theories. We first study the Hawking-Page transition in all three cases, and find that there is a transition in all three scenarios at the temperature where the lengths of the two cycles of the torus are the same. We then study the entanglement entropy in the thermofield double states above the Hawking-Page transition, of regions symmetrically placed on the two boundaries. We consider the case where the region is one interval on each side, and the case where it is two intervals on each side. We give an entanglement tsunami interpretation of the time-evolution of the entanglement entropies.


title: Rigorous numerical integration of algebraic functions

abstract: We present an algorithm which uses Fujiwara's inequality to bound algebraic functions over ellipses of a certain type, allowing us to concretely implement a rigorous Gauss-Legendre integration method for algebraic functions over a line segment. We consider path splitting strategies to improve convergence of the method and show that these yield significant practical and asymptotic benefits. We implemented these methods to compute period matrices of algebraic Riemann surfaces and these are available in SageMath.


title: On the Burau representation of $B_3$

abstract: We study the Burau representation of the braid group $B_n$ in the case where $n=3$. We give three novel topological proofs that the Burau representation of $B_3$ is faithful, and a proof that it's faithful modulo $p$ for all integers $p>1$. We then classify conjugacy classes in the image of the Burau representation in $\text{GL}(2, \mathbb{Z}[t, t^{-1}])$ in a way that takes account of the fact that braids are geometrically oriented, and use that fact to give a new, linear time solution to the conjugacy problem in $B_3$. We pose several open problems about $B_n$.


title: Challenges and opportunities to assure future manufacturing of magnet conductors for the accelerator sector

abstract: We take a comprehensive look at conductors used in superconducting magnets for the accelerator sector and explore the ramifications of the present marketplace for supply of conductor to future accelerator facilities. While there are thousands of superconductors, many of which have promising properties for applications, we outline the journey a promising material must take to become a magnet conductor that is manufactured at the scale needed for an accelerator facility. Among the few materials that actually reach this scale, Nb$_{3}$Sn is arguably the workhorse conductor for the next generation of accelerators. Yet, a marketplace pull equivalent to the medical imaging magnet industry, which consumes close to 1000 tons of commodity-scale Nb-Ti conductor per year, has not emerged. This aspect greatly complicates the steps that must be taken to assure readiness of manufacturing for the next accelerator facility. Meanwhile, high-temperature superconductors (HTS), which are capable of extremely high fields at low temperature, are advancing rapidly as magnet conductors, and the long horizons of large physics projects could provide time for them to emerge and displace Nb-based materials. We close by examining in more detail the ecosystem that connects accelerator magnet conductors with broader industry applications, in particular areas that are presently in rapid development such as fusion and wind turbines and which would potentially require hundreds of tons of conductor.


title: Novel phenomena of the Hartle-Hawking wave function

abstract: We find a novel phenomenon in the solution to the Wheeler-DeWitt equation by solving numerically the equation assuming $O(4)$-symmetry and imposing the Hartle-Hawking wave function as a boundary condition. In the slow-roll limit, as expected, the numerical solution gives the most dominant steepest-descent that describes the probability distribution for the initial condition of a universe. The probability is consistent with the Euclidean computations, and the overall shape of the wave function is compatible with analytical approximations, although there exist novel differences in the detailed probability computation. Our approach gives an alternative point of view of the no-boundary wave function from the wave function point of view. Possible interpretations and conceptual issues of this wave function are discussed.


title: Consensusless Blockchain: A Promising High-Performance Blockchain without Consensus

abstract: Consensus is unnecessary when the truth is available. In this paper, we present a new perspective of rebuilding the blockchain without consensus. When the consensus phase is eliminated from a blockchain, transactions could be canonized quickly using a well-defined universal rule without consuming hashing power. Thus, the transactions per second(TPS) metric of such the consensusless blockchain can be largely boosted. Although consensus blockchain is promising, several technical challenges are also crucial. For example, double-spending attacks and frequent forking events must be prevented, the credit of block's minting must be carefully defined, and etc. To address those technical challenges, we propose several solutions for our consensusless blockchain (CB), including a naive monotonic scoring mechanism to calculate the ranking of each block in the chain, and a two-stage witness mechanism to add new blocks. The proposed CB chain is promising to offer a simplified and equipment-cheap infrastructure for rich real-world decentralized applications.


title: Expansion and evolution of the R programming language

abstract: Change in language use is driven by cultural forces; it is unclear whether that extends to programming languages. They are designed to be used by humans, but interaction with computer hardware rather than a human audience may limit opportunities for evolution of the lexicon of used terms. I tested this in R, an open source, mature and commonly used programming language for statistical computing. In corpus of 360,321 GitHub repositories published between 2014 and 2021, I extracted 168,857,044 function calls to act as n-grams of the R language. Over the eight-year period, R rapidly diversified and underwent substantial lexical change, driven by increasing popularity of the tidyverse collection of community packages. My results provide evidence that users can influence the evolution of programming languages, with patterns that match those observed in natural languages and reflect genetic evolution. R's evolution may have been driven by increased analytic complexity, driving new users to R, creating both selective pressure for an alternate lexicon and accompanying advective change. The speed and magnitude of this change may have flow-on consequences for the readability and continuity of analytic and scientific inquiries codified in R and similar languages.


title: High-dimensional sparse vine copula regression with application to genomic prediction

abstract: High-dimensional data sets are often available in genome-enabled predictions. Such data sets include nonlinear relationships with complex dependence structures. For such situations, vine copula based (quantile) regression is an important tool. However, the current vine copula based regression approaches do not scale up to high and ultra-high dimensions. To perform high-dimensional sparse vine copula based regression, we propose two methods. First, we show their superiority regarding computational complexity over the existing methods. Second, we define relevant, irrelevant, and redundant explanatory variables for quantile regression. Then we show our method's power in selecting relevant variables and prediction accuracy in high-dimensional sparse data sets via simulation studies. Next, we apply the proposed methods to the high-dimensional real data, aiming at the genomic prediction of maize traits. Some data-processing and feature extraction steps for the real data are further discussed. Finally, we show the advantage of our methods over linear models and quantile regression forests in simulation studies and real data applications.


title: Pure nematic state in iron-based superconductor

abstract: Lattice and electronic states of thin FeSe films on LaAlO$_3$ substrates are investigated in the vicinity of the nematic phase transition. No evidence of structural phase transition is found by x-ray diffraction below $T^\ast \sim 90$ K, while results obtained from resistivity measurement and angle-resolved photoemission spectroscopy clearly show the appearance of a nematic state. These results indicate formation of a pure nematic state in the iron-based superconductor and provide conclusive evidence that the nematic state originates from the electronic degrees of freedom. This pure nematicity in the thin film implies difference in the electron-lattice interaction from bulk FeSe crystals. FeSe films provide valuable playgrounds for observing the pure response of "bare" electron systems free from the electron-lattice interaction, and should make important contribution to investigate nematicity and its relationship with superconductivity.


title: The Far-/Near-Field Beam Squint and Solutions for THz Intelligent Reflecting Surface Communications

abstract: Terahertz (THz) and intelligent reflecting surface (IRS) have been regarded as two promising technologies to improve the capacity and coverage for future 6G networks. Generally, IRS is usually equipped with large-scale elements when implemented at THz frequency. In this case, the near-field model and beam squint should be considered. Therefore, in this paper, we investigate the far-field and near-field beam squint problems in THz IRS communications for the first time. The far-field and near-field channel models are constructed based on the different electromagnetic radiation characteristics. Next, we first analyze the far-field beam squint and its effect for the beam gain based on the cascaded base station (BS)-IRS-user channel model, and then the near-field case is studied. To overcome the far-field and near-field beam squint effects, we propose to apply delay adjustable metasurface (DAM) to IRS, and develop a scheme of optimizing the reflecting phase shifts and time delays of IRS elements, which effectively eliminates the beam gain loss caused by beam squint. Finally, simulations are conducted to demonstrate the effectiveness of our proposed schemes in combating the near and far field beam squint.


title: Swarm Analytics: Designing Information Markers to Characterise Swarm Systems in Shepherding Contexts

abstract: Contemporary swarm indicators are often used in isolation, focused on extracting information at the individual or collective levels. Consequently, these are seldom integrated to infer a top-level operating picture of the swarm, its members, and its overall collective dynamics. The primary contribution of this paper is to organise a suite of indicators about swarms into an ontologically-arranged collection of information markers to characterise the swarm from the perspective of an external observer\textemdash, a recognition agent. Our contribution shows the foundations for a new area of research that we tile swarm analytics, whose primary concern is with the design and organisation of collections of swarm markers to understand, detect, recognise, track, and learn a particular insight about a swarm system. We present our designed framework of information markers that offer a new avenue for swarm research, especially for heterogeneous and cognitive swarms that may require more advanced capabilities to detect agencies and categorise agent influences and responses.


title: Music Separation Enhancement with Generative Modeling

abstract: Despite phenomenal progress in recent years, state-of-the-art music separation systems produce source estimates with significant perceptual shortcomings, such as adding extraneous noise or removing harmonics. We propose a post-processing model (the Make it Sound Good (MSG) post-processor) to enhance the output of music source separation systems. We apply our post-processing model to state-of-the-art waveform-based and spectrogram-based music source separators, including a separator unseen by MSG during training. Our analysis of the errors produced by source separators shows that waveform models tend to introduce more high-frequency noise, while spectrogram models tend to lose transients and high frequency content. We introduce objective measures to quantify both kinds of errors and show MSG improves the source reconstruction of both kinds of errors. Crowdsourced subjective evaluations demonstrate that human listeners prefer source estimates of bass and drums that have been post-processed by MSG.


title: A New Polar Ring Galaxy Discovered in the COSMOS Field

abstract: In order to understand the formation and evolution of galaxies fully, it is important to study their three-dimensional gravitational potential for a large sample of galaxies. Since polar-ring galaxies (PRGs) provide useful laboratories for this investigation, we have started our detailed study of a sample of known PRGs by using the data set obtained by the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). During the course of this study, we have discovered a new PRG, identified as SDSS J095351.58+012036.1. Its photometric redshift is estimated as z ~ 0.2. The polar ring structure in this PRG appears to be almost perpendicular to the disk of its host galaxy without any disturbed features. Therefore, this PRG will provide us with useful information on the formation of such an undisturbed polar structure. We discuss its photometric properties in detail.


title: Static Seeding and Clustering of LSTM Embeddings to Learn from Loosely Time-Decoupled Events

abstract: Humans learn from the occurrence of events in a different place and time to predict similar trajectories of events. We define Loosely Decoupled Timeseries (LDT) phenomena as two or more events that could happen in different places and across different timelines but share similarities in the nature of the event and the properties of the location. In this work we improve on the use of Recurring Neural Networks (RNN), in particular Long Short-Term Memory (LSTM) networks, to enable AI solutions that generate better timeseries predictions for LDT. We use similarity measures between timeseries based on the trends and introduce embeddings representing those trends. The embeddings represent properties of the event which, coupled with the LSTM structure, can be clustered to identify similar temporally unaligned events. In this paper, we explore methods of seeding a multivariate LSTM from time-invariant data related to the geophysical and demographic phenomena being modeled by the LSTM. We apply these methods on the timeseries data derived from the COVID-19 detected infection and death cases. We use publicly available socio-economic data to seed the LSTM models, creating embeddings, to determine whether such seeding improves case predictions. The embeddings produced by these LSTMs are clustered to identify best-matching candidates for forecasting an evolving timeseries. Applying this method, we show an improvement in 10-day moving average predictions of disease propagation at the US County level.


title: Proofs of Quantumness from Trapdoor Permutations

abstract: Assume that Alice can do only classical probabilistic polynomial-time computing while Bob can do quantum polynomial-time computing. Alice and Bob communicate over only classical channels, and finally Bob gets a state $|x_0\rangle+|x_1\rangle$ with some bit strings $x_0$ and $x_1$. Is it possible that Alice can know $\{x_0,x_1\}$ but Bob cannot? Such a task, called {\it remote state preparations}, is indeed possible under some complexity assumptions, and is bases of many quantum cryptographic primitives such as proofs of quantumness, (classical-client) blind quantum computing, (classical) verifications of quantum computing, and quantum money. A typical technique to realize remote state preparations is to use 2-to-1 trapdoor collision resistant hash functions: Alice sends a 2-to-1 trapdoor collision resistant hash function $f$ to Bob, and Bob evaluates it on superposition and measures the image. Bob's post-measurement state is $|x_0\rangle+|x_1\rangle$, where $f(x_0)=f(x_1)=y$. With the trapdoor, Alice can learn $\{x_0,x_1\}$, but due to the collision resistance, Bob cannot. This Alice's advantage can be leveraged to realize the quantum cryptographic primitives listed above. It seems that the collision resistance is essential here. In this paper, surprisingly, we show that the collision resistance is not necessary for a restricted case: we show that (non-verifiable) remote state preparations of $|x_0\rangle+|x_1\rangle$ secure against {\it classical} probabilistic polynomial-time Bob can be constructed from classically-secure (full-domain) trapdoor permutations. Trapdoor permutations are not likely to imply the collision resistance, because black-box reductions from collision-resistant hash functions to trapdoor permutations are known to be impossible. As an application of our result, we construct proofs of quantumness from classically-secure (full-domain) trapdoor permutations.


title: The Explicit Local Langlands Correspondence for $G_2$

abstract: We develop a general strategy for constructing the explicit Local Langlands Correspondences for $p$-adic reductive groups via reduction to LLC for supercuspidal representations of proper Levi subgroups, using Hecke algebra techniques. As an example of our general strategy, we construct the explicit Local Langlands Correspondence for the exceptional group $G_2$ over a nonarchimedean local field, with explicit $L$-packets and explicit matching between the group and Galois sides. We also give a list of characterizing properties for our LLC. In \cite{G2-stability}, we complete unique characterization using stability property of our $L$-packets. For intermediate series, we build on our previous results on Hecke algebras. For principal series, we improve previous works of Muic etc. and obtain more explicit descriptions on both group and Galois sides. Moreover, we show the existence of non-unipotent \textit{singular} supercuspidal representations of $G_2$, and exhibit them in \textit{mixed} $L$-packets mixing supercuspidal representations with non-supercuspidal ones. Furthermore, our LLC satisfies a list of expected properties, including the compatibility with cuspidal support.


title: DiVa: An Accelerator for Differentially Private Machine Learning

abstract: The widespread deployment of machine learning (ML) is raising serious concerns on protecting the privacy of users who contributed to the collection of training data. Differential privacy (DP) is rapidly gaining momentum in the industry as a practical standard for privacy protection. Despite DP's importance, however, little has been explored within the computer systems community regarding the implication of this emerging ML algorithm on system designs. In this work, we conduct a detailed workload characterization on a state-of-the-art differentially private ML training algorithm named DP-SGD. We uncover several unique properties of DP-SGD (e.g., its high memory capacity and computation requirements vs. non-private ML), root-causing its key bottlenecks. Based on our analysis, we propose an accelerator for differentially private ML named DiVa, which provides a significant improvement in compute utilization, leading to 2.6x higher energy-efficiency vs. conventional systolic arrays.


title: Master Curves for FENE-P Fluids in Steady Shear Flow

abstract: The FENE-P (Finitely-Extensible Nonlinear Elastic) dumbbell constitutive equation is widely used in simulations and stability analyses of free and wall-bounded viscoelastic shear flows due to its relative simplicity and accuracy in predicting macroscopic properties of dilute polymer solutions. The model contains three independent material parameters, which expressed in dimensionless form correspond to a Weissenberg number ($\textrm{Wi}$), i.e., the ratio of the dumbbell relaxation time scale to a characteristic flow time scale, a finite extensibility parameter ($L$), corresponding to the ratio of the fully extended dumbbell length to the root mean square end-to-end separation of the polymer chain under equilibrium conditions, and a solvent viscosity ratio, commonly denoted $\beta$. An exact solution for the rheological predictions of the FENE-P model in steady simple shear flow is available [Sureshkumar et al., Phys Fluids (1997)], but the resulting nonlinear and nested set of equations do not readily reveal the key shear-thinning physics that dominates at high $\textrm{Wi}$ as a result of the finite extensibility of the polymer chain. In this note we review a simple way of evaluating the steady material functions characterizing the nonlinear evolution of the polymeric contributions to the shear stress and first normal stress difference as the shear rate increases, provide asymptotic expansions as a function of $\textrm{Wi}$ , and show that it is in fact possible to construct universal master curves for these two material functions as well as the corresponding stress ratio. Steady shear flow experiments on three highly elastic dilute polymer solutions of different finite extensibilities also follow the identified master curves. The governing dimensionless parameter for these master curves is $\textrm{Wi}/L$ and it is only in strong shear flows exceeding $\textrm{Wi}/L \gtrsim 1$ that the effects of finite extensibility of the polymer chains dominate the evolution of polymeric stresses in the flow field. We suggest that reporting the magnitude of $\textrm{Wi}/L$ when performing stability analyses or simulating shear-dominated flows with the FENE-P model will help clarify finite extensibility effects.


title: Zero-Inflated Poisson Cluster-Weighted Models: Properties and Applications

abstract: In this paper, I propose a new class of Zero-Inflated Poisson models into the family of Cluster Weighted Models (CWMs) called Zero-Inflated Poisson CWMs (ZIPCWM). ZIPCWM extends Poisson cluster weighted models and other mixture models. I propose an Expectation-Maximization (EM) algorithm via an iteratively reweighted least squares for the model. I theoretically and analytically investigate the identifiability of the proposed model through an extensive simulation study. Parameter recovery, classification assessment, and performance of different information criteria are investigated through broad simulation design. ZIPCWM is applied to real data which accounts for excess zeros of over $40\%$. We explore the classification performance of ZIPCWM, Fixed Zero-inflated Poisson mixture model (FZIP), and Poisson cluster weighted model (PCWM) on the data. Based on the confusion matrix, ZIPCWM achieves $97.4\%$ classification power, PCWM achieves $67.30\%$, while FZIP has the worst classification performance. In conclusion, ZIPCWM outperforms both PCWM and FZIP models.


title: Improved Pump Setpoint Selection Using a Calibrated Hydraulic Model of a High-Pressure Irrigation System

abstract: This paper presents a case study of the operational management of the Robinvale high-pressure piped irrigation water delivery system (RVHPS) in Australia. Based on datasets available, improved pump setpoint selection using a calibrated hydraulic model is investigated. The first step was to implement pre-processing of measured flow and pressure data to identify errors in the data and possible faulty sensors. An EPANET hydraulic simulation model was updated with calibrated pipe roughness height values by using the processed pressure and flow data. Then, new pump setpoints were selected using the calibrated model given the actual measured demands such that the pressures in the network were minimized subject to required customer service standards. Based on a two-day simulation, it was estimated that 4.7% savings in pumping energy cost as well as 4.7% reduction in greenhouse gas emissions can be achieved by applying the new pump setpoints.


title: New research paradigms and agenda of human factors science in the intelligence era

abstract: This paper proposes the innovative concept of "human factors science" to characterize engineering psychology, human factors engineering, human-computer interaction, and other similar fields. Although the perspectives in these fields differ, they share a common approach: "human-centered design." In the AI era, the human-machine relationship presents a trans-era evolution to "human-AI teaming." The change has raised challenges for human factors science, compelling us to re-examine current research paradigms and agendas. Based on our previous work, this paper proposes three research paradigms: (1) human-AI joint cognitive systems: this regards an intelligent agent as a cognitive agent with a certain level of cognitive capabilities. A human-AI system can be characterized as a joint cognitive system in which humans and intelligent agents work as teammates for collaboration; (2) human-AI joint cognitive ecosystems: an intelligent ecosystem with multiple human-AI systems can be represented as a human-AI joint cognitive ecosystem. The overall performance of the ecosystem depends on optima collaboration and design across the multiple human-AI systems; (3) intelligent sociotechnical systems (iSTS): human-AI systems are design, developed, and deployed in an iSTS environment. The successful design, development, and deployment of a human-AI system within an iSTS environment depends on the synergistic optimization between the subsystems. This paper looks forward to the future research agenda of human factors science from three aspects: human-AI interaction, intelligent human-machine interface, and human-AI teaming. Analyses show that the three new research paradigms will benefit future research in human factors science. We believe the proposed research paradigms and the future research agenda will mutually promote each other, further advancing human factors science in the AI era.


title: Causal Inference in Recommender Systems: A Survey and Future Directions

abstract: Recommender systems have become crucial in information filtering nowadays. Existing recommender systems extract user preferences based on the correlation in data, such as behavioral correlation in collaborative filtering, feature-feature, or feature-behavior correlation in click-through rate prediction. However, unfortunately, the real world is driven by causality, not just correlation, and correlation does not imply causation. For instance, recommender systems might recommend a battery charger to a user after buying a phone, where the latter can serve as the cause of the former; such a causal relation cannot be reversed. Recently, to address this, researchers in recommender systems have begun utilizing causal inference to extract causality, thereby enhancing the recommender system. In this survey, we offer a comprehensive review of the literature on causal inference-based recommendation. Initially, we introduce the fundamental concepts of both recommender system and causal inference as the foundation for subsequent content. We then highlight the typical issues faced by non-causality recommender system. Following that, we thoroughly review the existing work on causal inference-based recommender systems, based on a taxonomy of three-aspect challenges that causal inference can address. Finally, we discuss the open problems in this critical research area and suggest important potential future works.


title: Few-Shot Learning Meets Transformer: Unified Query-Support Transformers for Few-Shot Classification

abstract: Few-shot classification which aims to recognize unseen classes using very limited samples has attracted more and more attention. Usually, it is formulated as a metric learning problem. The core issue of few-shot classification is how to learn (1) consistent representations for images in both support and query sets and (2) effective metric learning for images between support and query sets. In this paper, we show that the two challenges can be well modeled simultaneously via a unified Query-Support TransFormer (QSFormer) model. To be specific,the proposed QSFormer involves global query-support sample Transformer (sampleFormer) branch and local patch Transformer (patchFormer) learning branch. sampleFormer aims to capture the dependence of samples in support and query sets for image representation. It adopts the Encoder, Decoder and Cross-Attention to respectively model the Support, Query (image) representation and Metric learning for few-shot classification task. Also, as a complementary to global learning branch, we adopt a local patch Transformer to extract structural representation for each image sample by capturing the long-range dependence of local image patches. In addition, a novel Cross-scale Interactive Feature Extractor (CIFE) is proposed to extract and fuse multi-scale CNN features as an effective backbone module for the proposed few-shot learning method. All modules are integrated into a unified framework and trained in an end-to-end manner. Extensive experiments on four popular datasets demonstrate the effectiveness and superiority of the proposed QSFormer.


title: Lorentz violation in electromagnetic moments of fermions

abstract: Lorentz-violating Yukawa couplings lying within the renormalizable part of the SME generate Lorentz-invariant one-loop contributions to electromagnetic moments of fermions. These proceedings provide a discussion on such contributions and present bounds on SME coefficients from experimental data on electromagnetic moments. Constraints as restrictive as $\sim10^{-14}$ are found.


title: Synthesis of Distributed Agreement-Based Systems with Efficiently-Decidable Verification (Extended Version)

abstract: Distributed agreement-based (DAB) systems use common distributed agreement protocols such as leader election and consensus as building blocks for their target functionality. While automated verification for DAB systems is undecidable in general, recent work identifies a large class of DAB systems for which verification is efficiently-decidable. Unfortunately, the conditions characterizing such a class can be opaque and non-intuitive, and can pose a significant challenge to system designers trying to model their systems in this class. In this paper, we present a synthesis-driven tool, Cinnabar, to help system designers building DAB systems "fit" their intended designs into an efficiently-decidable class. In particular, starting from an initial sketch provided by the designer, Cinnabar generates sketch completions using a counterexample-guided procedure. The core technique relies on a compact encoding of a set of related counterexamples. We demonstrate Cinnabar's effectiveness by successfully and efficiently synthesizing completions for a variety of interesting DAB systems.


title: Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximation

abstract: Recent work on mini-batch consistency (MBC) for set functions has brought attention to the need for sequentially processing and aggregating chunks of a partitioned set while guaranteeing the same output for all partitions. However, existing constraints on MBC architectures lead to models with limited expressive power. Additionally, prior work has not addressed how to deal with large sets during training when the full set gradient is required. To address these issues, we propose a Universally MBC (UMBC) class of set functions which can be used in conjunction with arbitrary non-MBC components while still satisfying MBC, enabling a wider range of function classes to be used in MBC settings. Furthermore, we propose an efficient MBC training algorithm which gives an unbiased approximation of the full set gradient and has a constant memory overhead for any set size for both train- and test-time. We conduct extensive experiments including image completion, text classification, unsupervised clustering, and cancer detection on high-resolution images to verify the efficiency and efficacy of our scalable set encoding framework. Our code is available at github.com/jeffwillette/umbc


title: Extending the practical applicability of the Kalman Filter

abstract: A Schmidt filter is a modification of the Kalman filter that allows to append system parameters as states and considers their uncertainty effect in the filtering process without attempting to estimate such parameters. The states that are only considered but not estimated, are generally known as \textit{consider} or \textit{considered} states. The main contributions of this research are the formulations of a Schmidt-Kalman filter that incorporates the numerical robustness of the well-known square root and factorized filtering forms plus the capacity of actively attempting to update the \textit{considered} states. The filters formulations proposed in this research are a fundamental extension of the Kalman filter. Therefore, the formulations of this work also apply within the Extended Kalman filter framework. More importantly, they are shown to handle nonlinearities, larger initial uncertainties, and poorly conditioned systems better than a typical Extended or Schmidt Kalman filter. Because the new filters are directly based on the Schmidt filter, they offer a novel and straight-forward filtering framework, allowing the use of a more simple filter where a more advanced or elaborated technique could have been needed.


title: BITS: Bi-level Imitation for Traffic Simulation

abstract: Simulation is the key to scaling up validation and verification for robotic systems such as autonomous vehicles. Despite advances in high-fidelity physics and sensor simulation, a critical gap remains in simulating realistic behaviors of road users. This is because, unlike simulating physics and graphics, devising first principle models for human-like behaviors is generally infeasible. In this work, we take a data-driven approach and propose a method that can learn to generate traffic behaviors from real-world driving logs. The method achieves high sample efficiency and behavior diversity by exploiting the bi-level hierarchy of driving behaviors by decoupling the traffic simulation problem into high-level intent inference and low-level driving behavior imitation. The method also incorporates a planning module to obtain stable long-horizon behaviors. We empirically validate our method, named Bi-level Imitation for Traffic Simulation (BITS), with scenarios from two large-scale driving datasets and show that BITS achieves balanced traffic simulation performance in realism, diversity, and long-horizon stability. We also explore ways to evaluate behavior realism and introduce a suite of evaluation metrics for traffic simulation. Finally, as part of our core contributions, we develop and open source a software tool that unifies data formats across different driving datasets and converts scenes from existing datasets into interactive simulation environments. For additional information and videos, see https://sites.google.com/view/nvr-bits2022/home


title: Discrete two-generator subgroups of ${\rm PSL_2}$ over non-archimedean local fields

abstract: Let $K$ be a non-archimedean local field with residue field of characteristic $p$. We give necessary and sufficient conditions for a two-generator subgroup $G$ of ${\rm PSL_2}(K)$ to be discrete, where either $K=\mathbb{Q}_p$ or $G$ contains no elements of order $p$. We give a practical algorithm to decide whether such a subgroup $G$ is discrete. We also give practical algorithms to decide whether a two-generator subgroup of either ${\rm SL_2}(\mathbb{R})$ or ${\rm SL_2}(K)$ (where $K$ is a finite extension of $\mathbb{Q}_p$) is dense. A crucial ingredient for this work is a structure theorem for two-generator groups acting by isometries on a $\Lambda$-tree.


title: Measurements of the $^{27}{\rm Al}(\alpha,n)$ Thick Target Yield Near Threshold

abstract: We present results from direct measurements of the $^{27}{\rm Al}(\alpha,n)$ thick target yield from laboratory incident energies $E_{\alpha}\approx$ 3$-$5~MeV, performed with the $^{3}$HeBF$_{3}$ Giant Barrel (HeBGB) neutron detector at the Edwards Accelerator Laboratory. Our measurements have a small energy cadence in order to address discrepancies and sparseness of thick-target yield data sets existing for this energy region. We find general agreement with existing data sets, including yields derived from cross section data, while resolving a discrepancy between existing thick-target yield data sets for $E_{\alpha}\approx4-5$~MeV. However, for $E_{\alpha}<3.5$~MeV, our results are substantially lower than previous thick-target yield data and somewhat larger than yields calculated from existing cross section data. Our data complete the energy-range needed for estimates of the $^{27}{\rm Al}(\alpha,n)$ contribution to neutrino and dark matter detector backgrounds and result in increased viability of $^{27}{\rm Al}(\alpha,n)$ as a plasma diagnostic tool at fusion facilities such as the National Ignition Facility.


title: On Polynomial Interpolation on Arbitrary Varieties

abstract: To the best of our knowledge this paper is the first attempt to introduce and study polynomial interpolation of the polynomial data given on arbitrary varieties. In the first part of the paper we present results on the solvability of such problems. In the second part of the paper we relate the interpolation problem to polynomial solution of some boundary values problems. In particular, we extend a result of W. K. Hayman and Z. G. Shanidze.


title: Revisit on spectral geometric mean

abstract: In this paper we introduce the limit, unique solution of the nonlinear equations, geodesic property, tolerance relations and pinch on the spectral geometric mean for two positive definite operators. We show that the spectral geometric mean is a geodesic with respect to some semi-metric. We also prove that the tolerance relation on determinant one matrices can be characterized by the spectral geometric mean. Moreover, two positive tuples can be pinched by the spectral geometric mean.


title: User-Controllable Latent Transformer for StyleGAN Image Layout Editing

abstract: Latent space exploration is a technique that discovers interpretable latent directions and manipulates latent codes to edit various attributes in images generated by generative adversarial networks (GANs). However, in previous work, spatial control is limited to simple transformations (e.g., translation and rotation), and it is laborious to identify appropriate latent directions and adjust their parameters. In this paper, we tackle the problem of editing the StyleGAN image layout by annotating the image directly. To do so, we propose an interactive framework for manipulating latent codes in accordance with the user inputs. In our framework, the user annotates a StyleGAN image with locations they want to move or not and specifies a movement direction by mouse dragging. From these user inputs and initial latent codes, our latent transformer based on a transformer encoder-decoder architecture estimates the output latent codes, which are fed to the StyleGAN generator to obtain a result image. To train our latent transformer, we utilize synthetic data and pseudo-user inputs generated by off-the-shelf StyleGAN and optical flow models, without manual supervision. Quantitative and qualitative evaluations demonstrate the effectiveness of our method over existing methods.


title: New disordered anyon phase of doped graphene zigzag nanoribbon

abstract: We investigate interacting disordered zigzag nanoribbons at low doping, using the Hubbard model to treat electron interactions within the density matrix renormalization group and Hartree-Fock method. Extra electrons that are inserted into an interacting disordered zigzag nanoribbon divide into anyons. Furthermore, the fractional charges form a new disordered anyon phase with a highly distorted edge spin density wave, containing numerous localized magnetic moments residing on the zigzag edges, thereby displaying spin-charge separation and a strong non-local correlation between the opposite zigzag edges. We make the following new predictions, which can be experimentally tested: (1) In the low doping case and weak disorder regime, the soft gap in the tunneling density of states is replaced by a sharp peak at the midgap energy with two accompanying peaks. The $e^-/2$ fractional charges that reside on the boundary of the zigzag edges are responsible for these peaks. (2) We find that the midgap peak disappears as the doping concentration increases. The presence of $e-/2$ fractional charges will be strongly supported by the detection of these peaks. Doped zigzag ribbons may also exhibit unusual transport, magnetic, and inter-edge tunneling properties.


title: Leveraging Symmetrical Convolutional Transformer Networks for Speech to Singing Voice Style Transfer

abstract: In this paper, we propose a model to perform style transfer of speech to singing voice. Contrary to the previous signal processing-based methods, which require high-quality singing templates or phoneme synchronization, we explore a data-driven approach for the problem of converting natural speech to singing voice. We develop a novel neural network architecture, called SymNet, which models the alignment of the input speech with the target melody while preserving the speaker identity and naturalness. The proposed SymNet model is comprised of symmetrical stack of three types of layers - convolutional, transformer, and self-attention layers. The paper also explores novel data augmentation and generative loss annealing methods to facilitate the model training. Experiments are performed on the NUS and NHSS datasets which consist of parallel data of speech and singing voice. In these experiments, we show that the proposed SymNet model improves the objective reconstruction quality significantly over the previously published methods and baseline architectures. Further, a subjective listening test confirms the improved quality of the audio obtained using the proposed approach (absolute improvement of 0.37 in mean opinion score measure over the baseline system).


title: Hydrodynamic alignment with pressure II. Multispecies

abstract: We study the long-time hydrodynamic behavior of systems of multi-species which arise from agent-based description of alignment dynamics. The interaction between species is governed by an array of symmetric communication kernels. We prove that the crowd of different species flock towards the mean velocity if (i) cross-interactions form a heavy-tailed connected array of kernels, while (ii) self-interactions are governed by kernels with singular heads. The main new aspect here, is that flocking behavior holds without closure assumption on the specific form of pressure tensors. Specifically, we prove the long-time flocking behavior for connected arrays of multi-species, with self-interactions governed by entropic pressure laws [E. Tadmor, Swarming: hydrodynamic alignment with pressure, ArXiv 2208.11786, (2022)] and driven by fractional $p$-alignment. In particular, it follows that such multi-species hydrodynamics approaches a mono-kinetic description. This generalizes the mono-kinetic, "pressure-less" study in [S. He and E. Tadmor, A game of alignment: collective behavior of multi-species, AIHP (c) Non Linear Anal. 38(4) (2021) 1031-1053.]


title: Semi-classical asymptotics of partial Bergman kernels on $\mathbb{R}$-symmetric complex manifolds with boundary

abstract: Let $M$ be a relatively compact connected open subset with smooth connected boundary of a complex manifold $M'$. Let $(L,h^L)\rightarrow M'$ be a positive line bundle over $M'$. Suppose that $M'$ admits a holomorphic $\mathbb{R}$-action which preserves the boundary of $M$ and lifts to $L$. We establish the asymptotic expansion of a partial Bergman kernel associated to a package of Fourier modes of high frequency with respect to the $\mathbb{R}$-action in the high powers of $L$. As an application, we establish an $\mathbb{R}$-equivariant analogue of Fefferman's and Bell-Ligocka's result about smooth extension up to the boundary of biholomorphic maps between weakly pseudoconvex domains in $\mathbb{C}^n$. Another application concerns the embedding of pseudoconcave manifolds.


title: Segmentation of Parotid Gland Tumors Using Multimodal MRI and Contrastive Learning

abstract: Parotid gland tumor is a common type of head and neck tumor. Segmentation of the parotid glands and tumors by MR images is important for the treatment of parotid gland tumors. However, segmentation of the parotid glands is particularly challenging due to their variable shape and low contrast with surrounding structures. Recently deep learning has developed rapidly, which can handle complex problems. However, most of the current deep learning methods for processing medical images are still based on supervised learning. Compared with natural images, medical images are difficult to acquire and costly to label. Contrastive learning, as an unsupervised learning method, can more effectively utilize unlabeled medical images. In this paper, we used a Transformer-based contrastive learning method and innovatively trained the contrastive learning network with transfer learning. Then, the output model was transferred to the downstream parotid segmentation task, which improved the performance of the parotid segmentation model on the test set. The improved DSC was 89.60%, MPA was 99.36%, MIoU was 85.11%, and HD was 2.98. All four metrics showed significant improvement compared to the results of using a supervised learning model as a pre-trained model for the parotid segmentation network. In addition, we found that the improvement of the segmentation network by the contrastive learning model was mainly in the encoder part, so this paper also tried to build a contrastive learning network for the decoder part and discussed the problems encountered in the process of building.


title: An automated approach for consecutive tuning of quantum dot arrays

abstract: Recent progress has shown that the dramatically increased number of parameters has become a major issue in tuning of multi-quantum dot devices. The complicated interactions between quantum dots and gate electrodes cause the manual tuning process to no longer be efficient. Fortunately, machine learning techniques can automate and speed up the tuning of simple quantum dot systems. In this letter, we extend the techniques to tune multi-dot devices. We propose an automated approach that combines machine learning, virtual gates and a local-to-global method to realize the consecutive tuning of quantum dot arrays by dividing them into subsystems. After optimizing voltage configurations and establishing virtual gates to control each subsystem independently, a quantum dot array can be efficiently tuned to the few-electron regime with appropriate interdot tunnel coupling strength. Our experimental results show that this approach can consecutively tune quantum dot arrays into an appropriate voltage range without human intervention and possesses broad application prospects in large-scale quantum dot devices.


title: MuLan: A Joint Embedding of Music Audio and Natural Language

abstract: Music tagging and content-based retrieval systems have traditionally been constructed using pre-defined ontologies covering a rigid set of music attributes or text queries. This paper presents MuLan: a first attempt at a new generation of acoustic models that link music audio directly to unconstrained natural language music descriptions. MuLan takes the form of a two-tower, joint audio-text embedding model trained using 44 million music recordings (370K hours) and weakly-associated, free-form text annotations. Through its compatibility with a wide range of music genres and text styles (including conventional music tags), the resulting audio-text representation subsumes existing ontologies while graduating to true zero-shot functionalities. We demonstrate the versatility of the MuLan embeddings with a range of experiments including transfer learning, zero-shot music tagging, language understanding in the music domain, and cross-modal retrieval applications.