title: Random Walks in the High-Dimensional Limit I: The Wiener Spiral

abstract: We prove limit theorems for random walks with $n$ steps in the $d$-dimensional Euclidean space as both $n$ and $d$ tend to infinity. One of our results states that the path of such a random walk, viewed as a compact subset of the infinite-dimensional Hilbert space $\ell^2$, converges in probability in the Hausdorff distance up to isometry and also in the Gromov-Hausdorff sense to the Wiener spiral, as $d,n\to\infty$. Another group of results describes various possible limit distributions for the squared distance between the random walker at time $n$ and the origin.


title: Operationalizing Digital Self Determination

abstract: We live in an era of datafication, one in which life is increasingly quantified and transformed into intelligence for private or public benefit. When used responsibly, this offers new opportunities for public good. However, three key forms of asymmetry currently limit this potential, especially for already vulnerable and marginalized groups: data asymmetries, information asymmetries, and agency asymmetries. These asymmetries limit human potential, both in a practical and psychological sense, leading to feelings of disempowerment and eroding public trust in technology. Existing methods to limit asymmetries (e.g., consent) as well as some alternatives under consideration (data ownership, collective ownership, personal information management systems) have limitations to adequately address the challenges at hand. A new principle and practice of digital self-determination (DSD) is therefore required. DSD is based on existing concepts of self-determination, as articulated in sources as varied as Kantian philosophy and the 1966 International Covenant on Economic, Social and Cultural Rights. Updated for the digital age, DSD contains several key characteristics, including the fact that it has both an individual and collective dimension; is designed to especially benefit vulnerable and marginalized groups; and is context-specific (yet also enforceable). Operationalizing DSD in this (and other) contexts so as to maximize the potential of data while limiting its harms requires a number of steps. In particular, a responsible operationalization of DSD would consider four key prongs or categories of action: processes, people and organizations, policies, and products and technologies.


title: VGFlow: Visibility guided Flow Network for Human Reposing

abstract: The task of human reposing involves generating a realistic image of a person standing in an arbitrary conceivable pose. There are multiple difficulties in generating perceptually accurate images, and existing methods suffer from limitations in preserving texture, maintaining pattern coherence, respecting cloth boundaries, handling occlusions, manipulating skin generation, etc. These difficulties are further exacerbated by the fact that the possible space of pose orientation for humans is large and variable, the nature of clothing items is highly non-rigid, and the diversity in body shape differs largely among the population. To alleviate these difficulties and synthesize perceptually accurate images, we propose VGFlow. Our model uses a visibility-guided flow module to disentangle the flow into visible and invisible parts of the target for simultaneous texture preservation and style manipulation. Furthermore, to tackle distinct body shapes and avoid network artifacts, we also incorporate a self-supervised patch-wise "realness" loss to improve the output. VGFlow achieves state-of-the-art results as observed qualitatively and quantitatively on different image quality metrics (SSIM, LPIPS, FID).


title: GC-GRU-N for Traffic Prediction using Loop Detector Data

abstract: Because traffic characteristics display stochastic nonlinear spatiotemporal dependencies, traffic prediction is a challenging task. In this paper develop a graph convolution gated recurrent unit (GC GRU N) network to extract the essential Spatio temporal features. we use Seattle loop detector data aggregated over 15 minutes and reframe the problem through space and time. The model performance is compared o benchmark models; Historical Average, Long Short Term Memory (LSTM), and Transformers. The proposed model ranked second with the fastest inference time and a very close performance to first place (Transformers). Our model also achieves a running time that is six times faster than transformers. Finally, we present a comparative study of our model and the available benchmarks using metrics such as training time, inference time, MAPE, MAE and RMSE. Spatial and temporal aspects are also analyzed for each of the trained models.


title: CXTrack: Improving 3D Point Cloud Tracking with Contextual Information

abstract: 3D single object tracking plays an essential role in many applications, such as autonomous driving. It remains a challenging problem due to the large appearance variation and the sparsity of points caused by occlusion and limited sensor capabilities. Therefore, contextual information across two consecutive frames is crucial for effective object tracking. However, points containing such useful information are often overlooked and cropped out in existing methods, leading to insufficient use of important contextual knowledge. To address this issue, we propose CXTrack, a novel transformer-based network for 3D object tracking, which exploits ConteXtual information to improve the tracking results. Specifically, we design a target-centric transformer network that directly takes point features from two consecutive frames and the previous bounding box as input to explore contextual information and implicitly propagate target cues. To achieve accurate localization for objects of all sizes, we propose a transformer-based localization head with a novel center embedding module to distinguish the target from distractors. Extensive experiments on three large-scale datasets, KITTI, nuScenes and Waymo Open Dataset, show that CXTrack achieves state-of-the-art tracking performance while running at 34 FPS.


title: Demystify Self-Attention in Vision Transformers from a Semantic Perspective: Analysis and Application

abstract: Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However, many existing vision transformer (ViT) works simply inherent transformer designs from NLP to adapt vision tasks, while ignoring the fundamental difference between ``how MSA works in image and language settings''. Language naturally contains highly semantic structures that are directly interpretable by humans. Its basic unit (word) is discrete without redundant information, which readily supports interpretable studies on MSA mechanisms of language transformer. In contrast, visual data exhibits a fundamentally different structure: Its basic unit (pixel) is a natural low-level representation with significant redundancies in the neighbourhood, which poses obvious challenges to the interpretability of MSA mechanism in ViT. In this paper, we introduce a typical image processing technique, i.e., scale-invariant feature transforms (SIFTs), which maps low-level representations into mid-level spaces, and annotates extensive discrete keypoints with semantically rich information. Next, we construct a weighted patch interrelation analysis based on SIFT keypoints to capture the attention patterns hidden in patches with different semantic concentrations Interestingly, we find this quantitative analysis is not only an effective complement to the interpretability of MSA mechanisms in ViT, but can also be applied to 1) spurious correlation discovery and ``prompting'' during model inference, 2) and guided model pre-training acceleration. Experimental results on both applications show significant advantages over baselines, demonstrating the efficacy of our method.


title: Exploiting the Partly Scratch-off Lottery Ticket for Quantization-Aware Training

abstract: Quantization-aware training (QAT) receives extensive popularity as it well retains the performance of quantized networks. In QAT, the contemporary experience is that all quantized weights are updated for an entire training process. In this paper, this experience is challenged based on an interesting phenomenon we observed. Specifically, a large portion of quantized weights reaches the optimal quantization level after a few training epochs, which we refer to as the partly scratch-off lottery ticket. This straightforward-yet-valuable observation naturally inspires us to zero out gradient calculations of these weights in the remaining training period to avoid meaningless updating. To effectively find the ticket, we develop a heuristic method, dubbed lottery ticket scratcher (LTS), which freezes a weight once the distance between the full-precision one and its quantization level is smaller than a controllable threshold. Surprisingly, the proposed LTS typically eliminates 50%-70% weight updating and 25%-35% FLOPs of the backward pass, while still resulting on par with or even better performance than the compared baseline. For example, compared with the baseline, LTS improves 2-bit MobileNetV2 by 5.05%, eliminating 46% weight updating and 23% FLOPs of the backward pass. Code is at url{https://github.com/zysxmu/LTS}.


title: MapQA: A Dataset for Question Answering on Choropleth Maps

abstract: Choropleth maps are a common visual representation for region-specific tabular data and are used in a number of different venues (newspapers, articles, etc). These maps are human-readable but are often challenging to deal with when trying to extract data for screen readers, analyses, or other related tasks. Recent research into Visual-Question Answering (VQA) has studied question answering on human-generated charts (ChartQA), such as bar, line, and pie charts. However, little work has paid attention to understanding maps; general VQA models, and ChartQA models, suffer when asked to perform this task. To facilitate and encourage research in this area, we present MapQA, a large-scale dataset of ~800K question-answer pairs over ~60K map images. Our task tests various levels of map understanding, from surface questions about map styles to complex questions that require reasoning on the underlying data. We present the unique challenges of MapQA that frustrate most strong baseline algorithms designed for ChartQA and general VQA tasks. We also present a novel algorithm, Visual Multi-Output Data Extraction based QA (V-MODEQA) for MapQA. V-MODEQA extracts the underlying structured data from a map image with a multi-output model and then performs reasoning on the extracted data. Our experimental results show that V-MODEQA has better overall performance and robustness on MapQA than the state-of-the-art ChartQA and VQA algorithms by capturing the unique properties in map question answering.


title: Heat conduction in herbertsmithite: field dependence at the onset of the quantum spin liquid regime

abstract: We report thermal conductivity measurements on single crystals of herbertsmithite, over a wide range of temperatures (0.05-120 K) in magnetic fields up to 15 T. We also report measurements of the thermal Hall effect, found to be vanishingly small. At high temperatures, in the paramagnetic regime, the thermal conductivity has a negligible field dependence. Upon cooling and the development of correlations, the onset of a clear monotonic field dependence below about 20 K signals a new characteristic temperature scale that may reflect the subtle crossover towards the quantum spin liquid regime. Deconfined spinons, if present, are not detected and phonons, as the main carriers of heat, are strongly scattered by the intrinsic spin excitations and the magnetic defects. In view of the colossal fields required to affect the intrinsic spins, most of the field-induced evolution is attributed to the progressive polarization of some magnetic defects. By elaborating a phenomenological model, we extract the magnetization of these main scattering centers which does not resemble the Brillouin function for free spins 1/2, requiring to go beyond the paradigm of isolated paramagnetic spins. Besides, the onset of a nonmonotonic field dependence below about 2 K underlines the existence of another characteristic temperature scale, previously highlighted with other measurements, and sheds new light on the phase diagram of herbertsmithite down to the lowest temperatures.


title: ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training

abstract: Multilingual pre-trained models exhibit zero-shot cross-lingual transfer, where a model fine-tuned on a source language achieves surprisingly good performance on a target language. While studies have attempted to understand transfer, they focus only on MLM, and the large number of differences between natural languages makes it hard to disentangle the importance of different properties. In this work, we specifically highlight the importance of word embedding alignment by proposing a pre-training objective (ALIGN-MLM) whose auxiliary loss guides similar words in different languages to have similar word embeddings. ALIGN-MLM either outperforms or matches three widely adopted objectives (MLM, XLM, DICT-MLM) when we evaluate transfer between pairs of natural languages and their counterparts created by systematically modifying specific properties like the script. In particular, ALIGN-MLM outperforms XLM and MLM by 35 and 30 F1 points on POS-tagging for transfer between languages that differ both in their script and word order (left-to-right v.s. right-to-left). We also show a strong correlation between alignment and transfer for all objectives (e.g., rho=0.727 for XNLI), which together with ALIGN-MLM's strong performance calls for explicitly aligning word embeddings for multilingual models.


title: An upper bound for the minimum modulus in a covering system with squarefree moduli

abstract: Based on work of P. Balister, B. Bollob\'as, R. Morris, J. Sahasrabudhe and M. Tiba, we show that if a covering system has distinct squarefree moduli, then the minimum modulus is at most 118. We also show that in general the $k^{\rm th}$ smallest modulus in a covering system with distinct moduli (provided it is required for the covering) is bounded by an absolute constant.


title: Gauging the Gauge and Anomaly Resolution

abstract: In this paper, we explore the algebraic and geometric structures that arise from a procedure we dub "gauging the gauge", which involves the promotion of a certain global, coordinate independent symmetry to a local one. By gauging the global 1-form shift symmetry in a gauge theory, we demonstrate that the structure of a Lie algebra crossed-module and its associated 2-gauge theory arises. Moreover, performing this procedure once again on a 2-gauge theory generates a 3-gauge theory, based on Lie algebra 2-crossed-modules. As such, the physical procedure of "gauging the gauge" can be understood mathematically as a \textit{categorification}. Applications of such higher-gauge structures are considered, including gravity, higher-energy physics and condensed matter theory. Of particular interest is the mechanism of \textit{anomaly resolution}, in which one introduces a higher-gauge structure to absorb curvature excitations. This mechanism has been shown to allow one to consistently gauge an anomalous background symmetry in QFT.

categories: hep-th cond-mat.str-el gr-qc math-ph math.MP


title: Uniqueness of dg-lifts via restriction to injective objects

abstract: We prove a uniqueness result of dg-lifts for the derived pushforward and pullback functors of a flat morphism between separated Noetherian schemes, between the unbounded or bounded below derived categories of quasi-coherent sheaves. The technique is purely algebraic-categorical and involves reconstructing dg-lifts uniquely from their restrictions to the subcategories of injective objects.


title: On the phase space of fourth-order fiber-orientation tensors

abstract: Fiber-orientation tensors describe the relevant features of the fiber-orientation distribution compactly and are thus ubiquitous in injection-molding simulations and subsequent mechanical analyses. In engineering applications to date, the second-order fiber-orientation tensor is the basic quantity of interest, and the fourth-order fiber-orientation tensor is obtained via a closure approximation. Unfortunately, such a description limits the predictive capabilities of the modeling process significantly, because the wealth of possible fourth-order fiber-orientation tensors is not exploited by such closures, and the restriction to second-order fiber-orientation tensors implies artifacts. Closures based on the second-order fiber-orientation tensor face a fundamental problem - which fourth-order fiber-orientation tensors can be realized? In the literature, only necessary conditions for a fiber-orientation tensor to be connected to a fiber-orientation distribution are found. In this article, we show that the typically considered necessary conditions, positive semidefiniteness and a trace condition, are also sufficient for being a fourth-order fiber-orientation tensor in the physically relevant case of two and three spatial dimensions. Moreover, we show that these conditions are not sufficient in higher dimensions. The argument is based on convex duality and a celebrated theorem of D. Hilbert (1888) on the decomposability of positive and homogeneous polynomials of degree four. The result has numerous implications for modeling the flow and the resulting microstructures of fiber-reinforced composites, in particular for the effective elastic constants of such materials.


title: Tailoring on-surface molecular reactions and assembly through hydrogen-modified synthesis: From triarylamine monomer to 2D covalent organic framework

abstract: Relative to conventional wet-chemical synthesis techniques, on-surface synthesis of organic networks in ultrahigh vacuum has few control parameters. The molecular deposition rate and substrate temperature are typically the only synthesis variables to be adjusted dynamically. Here we demonstrate that reducing conditions in the vacuum environment can be created and controlled without dedicated sources -- relying only on backfilled hydrogen gas and ion gauge filaments -- and can dramatically influence the Ullmann-like on-surface reaction used for synthesizing two-dimensional covalent organic frameworks (2D COFs). Using tribromo dimethylmethylene-bridged triphenylamine ((Br$_3$)DTPA) as monomer precursors, we find that atomic hydrogen blocks aryl-aryl bond formation. Control of the relative monomer and hydrogen fluxes is used to produce large islands of self-assembled monomers, dimers, or macrocycle hexamers. On-surface synthesis of these oligomers, from a single precursor, circumvents potential challenges with protracted wet-chemical synthesis or low precursor volatility for large molecules. Using scanning tunneling microscopy and spectroscopy (STM/STS), we show that changes in the electronic states through this oligomer sequence provide an insightful view of the 2D-COF (synthesized in the absence of atomic hydrogen) as the endpoint in an evolution of electronic structures from the monomer.


title: Hybrid Transformers for Music Source Separation

abstract: A natural question arising in Music Source Separation (MSS) is whether long range contextual information is useful, or whether local acoustic features are sufficient. In other fields, attention based Transformers have shown their ability to integrate information over long sequences. In this work, we introduce Hybrid Transformer Demucs (HT Demucs), an hybrid temporal/spectral bi-U-Net based on Hybrid Demucs, where the innermost layers are replaced by a cross-domain Transformer Encoder, using self-attention within one domain, and cross-attention across domains. While it performs poorly when trained only on MUSDB, we show that it outperforms Hybrid Demucs (trained on the same data) by 0.45 dB of SDR when using 800 extra training songs. Using sparse attention kernels to extend its receptive field, and per source fine-tuning, we achieve state-of-the-art results on MUSDB with extra training data, with 9.20 dB of SDR.


title: Distinguishing Dynamic Phase Catalysis in Cu based nanostructures under Reverse Water Gas Shift Reaction

abstract: Increasing anthropogenic carbon dioxide (CO$_2$) emissions have led to rising global temperatures and climate change. Using earth-abundant metal-oxide catalysts such as Cu$_2$O for reducing CO$_2$ through RWGS reaction seems lucrative. In this work, we have used Cu$_2$O nanostructures and identified its activity, stability, and selectivity for reducing CO$_2$ to carbon monoxide (CO) which can be further hydrogenated to higher hydrocarbons using Fisher Tropsch synthesis. We have observed that the rate of CO$_2$ conversion increases by 4 times and significantly drops at 300 C where the catalyst was reduced to metallic Cu and the rate increases slightly as the temperature is further increased. The selectivity of CO$_2$ reduction is majorly towards CO with a trace amount of methane. We can further exploit the Mie resonance characteristics of Cu$_2$O nanocatalysts and in-situ generation of hydrogen for hydrogenation of CO$_2$ to enhance the activity of the catalysts. We can further identify the optimum size and shape of the nanocatalysts required and use hybrid nanostructures which can favor RWGS reaction thus improving the stability of these catalysts.


title: Jones' representations of R. Thompson's groups not induced by finite-dimensional ones

abstract: Given any linear isometry from a Hilbert space to its square one can explicitly construct a so-called Pythagorean unitary representation of Richard Thompson's group F. We introduce a condition on the isometry implying that the associated representation does not contain any induced representations by finite-dimensional ones. This provides the first result of this kind. We illustrate this theorem via a family of representations parametrised by the real 3-sphere for which all of them have this property except two sub-circles.


title: Conjugacy of free mappings embedded in a flow

abstract: In this paper we study free mappings of the plane, that is orientation preserving fixed point free homeomorphisms of $\mathbb{R}^2$. We provide a necessary and sufficient condition under which two free mappings of the plane that are embedded in flows are conjugate to one another using Haefliger-Reeb theory of plane foliations.


title: Unsupervised Feature Clustering Improves Contrastive Representation Learning for Medical Image Segmentation

abstract: Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar while forcing all other augmented images' representations to contrast. However, this instance-based contrastive learning leaves performance on the table by failing to maximize feature affinity between images with similar content while counter-productively pushing their representations apart. Recent improvements on this paradigm (e.g., leveraging multi-modal data, different images in longitudinal studies, spatial correspondences) either relied on additional views or made stringent assumptions about data properties, which can sacrifice generalizability and applicability. To address this challenge, we propose a new self-supervised contrastive learning method that uses unsupervised feature clustering to better select positive and negative image samples. More specifically, we produce pseudo-classes by hierarchically clustering features obtained by an auto-encoder in an unsupervised manner, and prevent destructive interference during contrastive learning by avoiding the selection of negatives from the same pseudo-class. Experiments on 2D skin dermoscopic image segmentation and 3D multi-class whole heart CT segmentation demonstrate that our method outperforms state-of-the-art self-supervised contrastive techniques on these tasks.


title: Environmental toxicity influences disease spread in consumer population

abstract: The study of infectious disease has been of interest to ecologists since long. The initiation of epidemic and the long term disease dynamics are largely influenced by the nature of the underlying consumer (host)-resource dynamics. Ecological traits of such systems may be often modulated by toxins released in the environment due to ongoing anthropogenic activities. This, in addition to toxin-mediated alteration of epidemiological traits, has a significant impact on disease progression in ecosystems which is quite less studied. In order to address this, we consider a mathematical model of disease transmission in consumer population where multiple traits are affected by environmental toxins. Long term dynamics show that the level of environmental toxin determines disease persistence, and increasing toxin may even eradicate the disease in certain circumstances. Furthermore, our results demonstrate bistability between different ecosystem states and the possibility of an abrupt transition from disease-free coexistence to disease-induced extinction of consumers. Overall the results from this study will help us gain fundamental insights into disease propagation in natural ecosystems in the face of present anthropogenic changes.


title: Robust Alzheimer's Progression Modeling using Cross-Domain Self-Supervised Deep Learning

abstract: Developing successful artificial intelligence systems in practice depends on both robust deep learning models and large, high-quality data. However, acquiring and labeling data can be prohibitively expensive and time-consuming in many real-world applications, such as clinical disease models. Self-supervised learning has demonstrated great potential in increasing model accuracy and robustness in small data regimes. In addition, many clinical imaging and disease modeling applications rely heavily on regression of continuous quantities. However, the applicability of self-supervised learning for these medical-imaging regression tasks has not been extensively studied. In this study, we develop a cross-domain self-supervised learning approach for disease prognostic modeling as a regression problem using medical images as input. We demonstrate that self-supervised pretraining can improve the prediction of Alzheimer's Disease progression from brain MRI. We also show that pretraining on extended (but not labeled) brain MRI data outperforms pretraining on natural images. We further observe that the highest performance is achieved when both natural images and extended brain-MRI data are used for pretraining.


title: Development of a new quantum trajectory molecular dynamics framework

abstract: An extension to the wave packet description of quantum plasmas is presented, where the wave packet can be elongated in arbitrary directions. A generalised Ewald summation is constructed for the wave packet models accounting for long-range Coulomb interactions and fermionic effects are approximated by purpose-built Pauli potentials, self-consistent with the wave packets used. We demonstrate its numerical implementation with good parallel support and close to linear scaling in particle number, used for comparisons with the more common wave packet employing isotropic states. Ground state and thermal properties are compared between the models with differences occurring primarily in the electronic subsystem. Especially, the electrical conductivity of dense hydrogen is investigated where a 15% increase in DC conductivity can be seen in our wave packet model compared to other models.


title: Observation of the $Y(4230)$ and evidence for a new vector charmonium-like state $Y(4710)$ in $e^{+}e^{-}\to K_{S}^{0} K_{S}^{0} J/\psi$

abstract: Cross sections for the process $e^{+} e^{-} \to K_{S}^{0} K_{S}^{0} J/\psi$ at center-of-mass energies from $4.128$ to $4.950$ GeV are measured using data samples with a total integrated luminosity of 21.2 fb$^{-1}$ collected by the BESIII detector operating at the BEPCII storage ring. The $Y(4230)$ state is observed in the energy dependence of the $e^{+} e^{-} \to K_{S}^{0} K_{S}^{0} J/\psi$ cross section for the first time with a statistical significance of 26.0$\sigma$. In addition, an enhancement around $4.710$ GeV, called the $Y(4710)$, is seen with a statistical significance of 4.2$\sigma$. There is no clear structure around $4.484$ GeV. Using a fit with a coherent sum of three Breit-Wigner functions, we determine the mass and width of the $Y(4230)$ state to be $4226.9 \pm 6.6 \pm 21.9$ MeV/$c^{2}$ and $71.7 \pm 16.2 \pm 31.4$ MeV, respectively, and the mass and width of the $Y(4710)$ state to be $4704.0 \pm 52.3 \pm 69.5$ MeV/$c^{2}$ and $183.2 \pm 114.0 \pm 90.8$ MeV, respectively, where the first uncertainties are statistical and the second are systematic. In addition, the average Born cross section ratio of $e^{+} e^{-} \to K_{S}^{0} K_{S}^{0} J/\psi$ to $e^{+} e^{-} \to K^{+} K^{-} J/\psi$ is measured to be $0.388_{-0.028}^{+0.035}\pm0.016$, or $0.426_{-0.031}^{+0.038}\pm0.018$ if three-body phase space is considered.


title: Quantum memory effects in atomic ensembles coupled to photonic cavities

abstract: In this article we explore the dynamics of many-body atomic systems symmetrically coupled to a single Lorentzian photonic cavity. Our study reveals interesting dynamical characteristics including non-zero steady states, superradiant decay, enhanced energy transfer and the ability to modulate oscillations in the atomic system by tuning environmental degrees of freedom. We also analyse a configuration consisting of a three-atom chain embedded in a photonic cavity. Similarly, we find a strong enhancement of the energy transfer rate between the two ends of the chain and identified specific initial conditions that lead to significantly reduced dissipation between the two atoms at the end of the chain. Another configuration of interest consists of two symmetrical detuned reservoirs with respect to the atomic system. In the single-atom case, we show that it is possible to enhance the decay rate of the system by modulating its reservoir detuning, while in the many-atom case, this results in dynamics akin to the on-resonant cavity. Finally, we examine the validity of rotating wave approximation through a direct comparison against the numerically exact hierarchical equations of motion approach. We find good agreement in the weak coupling regime while in the intermediate coupling regime, we identify qualitative similarities, but the rotating wave approximation becomes less reliable. In the moderate coupling regime, we find deviation of the steady states due to the formation of mixed photon atom states.


title: The wrong direction of Jensen's inequality is algorithmically right

abstract: Let $\mathcal{A}$ be an algorithm with expected running time $e^X$, conditioned on the value of some random variable $X$. We construct an algorithm $\mathcal{A'}$ with expected running time $O(e^{E[X]})$, that fully executes $\mathcal{A}$. In particular, an algorithm whose running time is a random variable $T$ can be converted to one with expected running time $O(e^{E[\ln T]})$, which is never worse than $O(E[T])$. No information about the distribution of $X$ is required for the construction of $\mathcal{A}'$.


title: ConvFormer: Combining CNN and Transformer for Medical Image Segmentation

abstract: Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution operations. Transformer based methods are capable of modelling long-range dependencies of information for capturing global representations, yet their ability to model local context is lacking. Integrating CNN and Transformer to learn both local and global representations while exploring multi-scale features is instrumental in further improving medical image segmentation. In this paper, we propose a hierarchical CNN and Transformer hybrid architecture, called ConvFormer, for medical image segmentation. ConvFormer is based on several simple yet effective designs. (1) A feed forward module of Deformable Transformer (DeTrans) is re-designed to introduce local information, called Enhanced DeTrans. (2) A residual-shaped hybrid stem based on a combination of convolutions and Enhanced DeTrans is developed to capture both local and global representations to enhance representation ability. (3) Our encoder utilizes the residual-shaped hybrid stem in a hierarchical manner to generate feature maps in different scales, and an additional Enhanced DeTrans encoder with residual connections is built to exploit multi-scale features with feature maps of different scales as input. Experiments on several datasets show that our ConvFormer, trained from scratch, outperforms various CNN- or Transformer-based architectures, achieving state-of-the-art performance.


title: Using Auxiliary Information for Person Re-Identification -- A Tutorial Overview

abstract: Person re-identification (re-id) is a pivotal task within an intelligent surveillance pipeline and there exist numerous re-id frameworks that achieve satisfactory performance in challenging benchmarks. However, these systems struggle to generate acceptable results when there are significant differences between the camera views, illumination conditions, or occlusions. This result can be attributed to the deficiency that exists within many recently proposed re-id pipelines where they are predominately driven by appearance-based features and little attention is paid to other auxiliary information that could aid the re-id. In this paper, we systematically review the current State-Of-The-Art (SOTA) methods in both uni-modal and multimodal person re-id. Extending beyond a conceptual framework, we illustrate how the existing SOTA methods can be extended to support these additional auxiliary information and quantitatively evaluate the utility of such auxiliary feature information, ranging from logos printed on the objects carried by the subject or printed on the clothes worn by the subject, through to his or her behavioural trajectories. To the best of our knowledge, this is the first work that explores the fusion of multiple information to generate a more discriminant person descriptor and the principal aim of this paper is to provide a thorough theoretical analysis regarding the implementation of such a framework. In addition, using model interpretation techniques, we validate the contributions from different combinations of the auxiliary information versus the original features that the SOTA person re-id models extract. We outline the limitations of the proposed approaches and propose future research directions that could be pursued to advance the area of multi-modal person re-id.


title: The Association Between SOC and Land Prices Considering Spatial Heterogeneity Based on Finite Mixture Modeling

abstract: An understanding of how Social Overhead Capital (SOC) is associated with the land value of the local community is important for effective urban planning. However, even within a district, there are multiple sections used for different purposes; the term for this is spatial heterogeneity. The spatial heterogeneity issue has to be considered when attempting to comprehend land prices. If there is spatial heterogeneity within a district, land prices can be managed by adopting the spatial clustering method. In this study, spatial attributes including SOC, socio-demographic features, and spatial information in a specific district are analyzed with Finite Mixture Modeling (FMM) in order to find (a) the optimal number of clusters and (b) the association among SOCs, socio-demographic features, and land prices. FMM is a tool used to find clusters and the attributes' coefficients simultaneously. Using the FMM method, the results show that four clusters exist in one district and the four clusters have different associations among SOCs, demographic features, and land prices. Policymakers and managerial administration need to look for information to make policy about land prices. The current study finds the consideration of closeness to SOC to be a significant factor on land prices and suggests the potential policy direction related to SOC.


title: Quantum Reservoir Computing Implementations for Classical and Quantum Problems

abstract: In this article we employ a model open quantum system consisting of two-level atomic systems coupled to Lorentzian photonic cavities, as an instantiation of a quantum physical reservoir computer. We then deployed the quantum reservoir computing approach to an archetypal machine learning problem of image recognition. We contrast the effectiveness of the quantum physical reservoir computer against a conventional approach using neural network of the similar architecture with the quantum physical reservoir computer layer removed. Remarkably, as the data set size is increased the quantum physical reservoir computer quickly starts out perform the conventional neural network. Furthermore, quantum physical reservoir computer provides superior effectiveness against number of training epochs at a set data set size and outperformed the neural network approach at every epoch number sampled. Finally, we have deployed the quantum physical reservoir computer approach to explore the quantum problem associated with the dynamics of open quantum systems in which an atomic system ensemble interacts with a structured photonic reservoir associated with a photonic band gap material. Our results demonstrate that the quantum physical reservoir computer is equally effective in generating useful representations for quantum problems, even with limited training data size.


title: Graph Sequential Neural ODE Process for Link Prediction on Dynamic and Sparse Graphs

abstract: Link prediction on dynamic graphs is an important task in graph mining. Existing approaches based on dynamic graph neural networks (DGNNs) typically require a significant amount of historical data (interactions over time), which is not always available in practice. The missing links over time, which is a common phenomenon in graph data, further aggravates the issue and thus creates extremely sparse and dynamic graphs. To address this problem, we propose a novel method based on the neural process, called Graph Sequential Neural ODE Process (GSNOP). Specifically, GSNOP combines the advantage of the neural process and neural ordinary differential equation that models the link prediction on dynamic graphs as a dynamic-changing stochastic process. By defining a distribution over functions, GSNOP introduces the uncertainty into the predictions, making it generalize to more situations instead of overfitting to the sparse data. GSNOP is also agnostic to model structures that can be integrated with any DGNN to consider the chronological and geometrical information for link prediction. Extensive experiments on three dynamic graph datasets show that GSNOP can significantly improve the performance of existing DGNNs and outperform other neural process variants.


title: Mixed Dimer Configuration Model in Type $D$ Cluster Algebras II: Beyond the Acyclic Case

abstract: This is a sequel to the second and third author's Mixed Dimer Configuration Model in Type $D$ Cluster Algebras where we extend our model to work for quivers that contain oriented cycles. Namely, we extend a combinatorial model for $F$-polynomials for type $D_n$ using dimer and double dimer configurations. In particular, we give a graph theoretic recipe that describes which monomials appear in such $F$-polynomials, as well as a graph theoretic way to determine the coefficients of each of these monomials. To prove this formula, we provide an explicit bijection between mixed dimer configurations and dimension vectors of submodules of an indecomposable Jacobian algebra module.


title: Dynamic-Pix2Pix: Noise Injected cGAN for Modeling Input and Target Domain Joint Distributions with Limited Training Data

abstract: Learning to translate images from a source to a target domain with applications such as converting simple line drawing to oil painting has attracted significant attention. The quality of translated images is directly related to two crucial issues. First, the consistency of the output distribution with that of the target is essential. Second, the generated output should have a high correlation with the input. Conditional Generative Adversarial Networks, cGANs, are the most common models for translating images. The performance of a cGAN drops when we use a limited training dataset. In this work, we increase the Pix2Pix (a form of cGAN) target distribution modeling ability with the help of dynamic neural network theory. Our model has two learning cycles. The model learns the correlation between input and ground truth in the first cycle. Then, the model's architecture is refined in the second cycle to learn the target distribution from noise input. These processes are executed in each iteration of the training procedure. Helping the cGAN learn the target distribution from noise input results in a better model generalization during the test time and allows the model to fit almost perfectly to the target domain distribution. As a result, our model surpasses the Pix2Pix model in segmenting HC18 and Montgomery's chest x-ray images. Both qualitative and Dice scores show the superiority of our model. Although our proposed method does not use thousand of additional data for pretraining, it produces comparable results for the in and out-domain generalization compared to the state-of-the-art methods.


title: Mean values of the logarithmic derivative of the Riemann zeta-function near the critical line

abstract: Assume the Riemann Hypothesis and a hypothesis on small gaps between zeta zeros, we prove a conjecture of Bailey, Bettin, Blower, Conrey, Prokhorov, Rubinstein and Snaith, which states that for any positive integer $K$ and real number $a>0$, \begin{align*} \lim_{a \to 0^+}\lim_{T \to \infty} \frac{(2a)^{2K-1}}{T (\log T)^{2K}} \int_{T}^{2T} \left|\frac{\zeta'}{\zeta}\left(\frac{1}{2}+\frac{a}{\log T}+it\right)\right|^{2K} dt = \binom{2K-2}{K-1}. \end{align*} When $K=1$, this was essentially a result of Goldston, Gonek and Montgomery.


title: Bayesian Fixed-Budget Best-Arm Identification

abstract: Fixed-budget best-arm identification (BAI) is a bandit problem where the agent maximizes the probability of identifying the optimal arm within a fixed budget of observations. In this work, we study this problem in the Bayesian setting. We propose a Bayesian elimination algorithm and derive an upper bound on its probability of misidentifying the optimal arm. The bound reflects the quality of the prior and is the first distribution-dependent bound in this setting. We prove it using a frequentist-like argument, where we carry the prior through, and then integrate out the bandit instance at the end. We also provide a lower bound on the probability of misidentification in a $2$-armed Bayesian bandit and show that our upper bound (almost) matches it for any budget. Our experiments show that Bayesian elimination is superior to frequentist methods and competitive with the state-of-the-art Bayesian algorithms that have no guarantees in our setting.


title: Realization of Causal Representation Learning to Adjust Confounding Bias in Latent Space

abstract: Causal DAGs(Directed Acyclic Graphs) are usually considered in a 2D plane. Edges indicate causal effects' directions and imply their corresponding time-passings. Due to the natural restriction of statistical models, effect estimation is usually approximated by averaging the individuals' correlations, i.e., observational changes over a specific time. However, in the context of Machine Learning on large-scale questions with complex DAGs, such slight biases can snowball to distort global models - More importantly, it has practically impeded the development of AI, for instance, the weak generalizability of causal models. In this paper, we redefine causal DAG as \emph{do-DAG}, in which variables' values are no longer time-stamp-dependent, and timelines can be seen as axes. By geometric explanation of multi-dimensional do-DAG, we identify the \emph{Causal Representation Bias} and its necessary factors, differentiated from common confounding biases. Accordingly, a DL(Deep Learning)-based framework will be proposed as the general solution, along with a realization method and experiments to verify its feasibility.


title: Solutions to the SU($\mathcal{N}$) self-dual Yang-Mills equation

abstract: In this paper we aim to derive solutions for the SU($\mathcal{N}$) self-dual Yang-Mills (SDYM) equation with arbitrary $\mathcal{N}$. A set of noncommutative relations are introduced to construct a matrix equation that can be reduced to the SDYM equation. It is shown that these relations can be generated from two different Sylvester equations, which correspond to the two Cauchy matrix schemes for the (matrix) Kadomtsev-Petviashvili hierarchy and the (matrix) Ablowitz-Kaup-Newell-Segur hierarchy, respectively. In each Cauchy matrix scheme we investigate the possible reductions that can lead to the SU$(\mathcal{N})$ SDYM equation and also analyze the physical significance of some solutions, i.e. being Hermitian, positive-definite and of determinant being one.


title: Observation of self-patterned defect formation in atomic superfluids -- from ring dark solitons to vortex dipole necklaces

abstract: Unveiling nonequilibrium dynamics of solitonic and topological defect structures in a multidimensional nonlinear medium is a current frontier across diverse fields. One of the quintessential objects is a ring dark soliton (RDS), whose dynamics are expected to display remarkable interplay between symmetry and self-patterned topological defect formation from a transverse (snake) instability, but it has thus far evaded full experimental observations. Here, we report an experimental realization of RDS generation in a two-dimensional atomic superfluid trapped in a circular box. By quenching the confining box potential, we observe an RDS emitted from the edge and its peculiar signature in the radial motion. As an RDS evolves, we observe transverse modulations at discrete azimuthal angles, which clearly result in a patterned formation of a circular vortex dipole array. Through collisions of the vortex dipoles with the box trap, we observe vortex unbinding, vortex pinning to the edge, and emission of rarefaction pulses. Our box-quench protocol opens a new way to study multidimensional dark solitons, structured formation of topological defects, and potentially the dynamics of ordered quantum vortex matter.


title: The Standard Model at 200 GeV

abstract: The Standard Model can be defined quantitatively by running parameters in a mass-independent renormalization scheme at a fixed reference scale. We provide a set of simple interpolation formulas that give the fundamental Lagrangian parameters in the $\bar{\rm MS}$ scheme at a renormalization scale of 200 GeV, safely above the top-quark mass and suitable for matching to candidate new physics models at very high mass scales using renormalization group equations. These interpolation formulas take as inputs the on-shell experimental quantities, and use the best available calculations in the pure $\bar{\rm MS}$ scheme. They also serve as an accounting of the parametric uncertainties for the short-distance Standard Model Lagrangian. We also include an interpolating formula for the W boson mass.


title: DCT Perceptron Layer: A Transform Domain Approach for Convolution Layer

abstract: In this paper, we propose a novel Discrete Cosine Transform (DCT)-based neural network layer which we call DCT-perceptron to replace the $3\times3$ Conv2D layers in the Residual neural Network (ResNet). Convolutional filtering operations are performed in the DCT domain using element-wise multiplications by taking advantage of the Fourier and DCT Convolution theorems. A trainable soft-thresholding layer is used as the nonlinearity in the DCT perceptron. Compared to ResNet's Conv2D layer which is spatial-agnostic and channel-specific, the proposed layer is location-specific and channel-specific. The DCT-perceptron layer reduces the number of parameters and multiplications significantly while maintaining comparable accuracy results of regular ResNets in CIFAR-10 and ImageNet-1K. Moreover, the DCT-perceptron layer can be inserted with a batch normalization layer before the global average pooling layer in the conventional ResNets as an additional layer to improve classification accuracy.


title: Anderson acceleration of gradient methods with energy for optimization problems

abstract: Anderson acceleration (AA) as an efficient technique for speeding up the convergence of fixed-point iterations may be designed for accelerating an optimization method. We propose a novel optimization algorithm by adapting Anderson acceleration to the energy adaptive gradient method (AEGD) [arXiv:2010.05109]. The feasibility of our algorithm is examined in light of convergence results for AEGD, though it is not a fixed-point iteration. We also quantify the accelerated convergence rate of AA for gradient descent by a factor of the gain at each implementation of the Anderson mixing. Our experimental results show that the proposed algorithm requires little tuning of hyperparameters and exhibits superior fast convergence.


title: Chromospheric and Coronal heating in active region plage by dissipation of currents from braiding

abstract: It remains unclear which physical processes are responsible for the dramatic increase with height of the temperature in stellar atmospheres, known as the chromospheric ($\sim$10,000 K) and coronal (several million K) heating problems. Statistical studies of sun-like stars reveal that chromospheric and coronal emissions are correlated on a global scale, constraining, in principle, theoretical models of potential heating mechanisms. However, so far, spatially resolved observations of the Sun have surprisingly failed to show a similar correlation on small spatial scales, leaving models poorly constrained. Here we use unique coordinated high-resolution observations of the chromosphere (from the Interface Region Imaging Spectrograph or IRIS satellite) and low corona (from the Hi-C 2.1 sounding rocket), and machine-learning based inversion techniques to show a strong correlation on spatial scales of a few hundred km between heating in the chromosphere and low corona for regions with strong magnetic field ("plage"). These results are compatible with recent advanced 3D radiative magnetohydrodynamic simulations in which dissipation of current sheets formed due to the braiding of the magnetic field lines deep in the atmosphere is responsible for heating the plasma simultaneously to chromospheric and coronal temperatures. Our results provide deep insight into the nature of the heating mechanism in solar active regions.


title: Sparse Signal Detection in Heteroscedastic Gaussian Sequence Models: Sharp Minimax Rates

abstract: Given a heterogeneous Gaussian sequence model with unknown mean $\theta \in \mathbb R^d$ and known covariance matrix $\Sigma = \operatorname{diag}(\sigma_1^2,\dots, \sigma_d^2)$, we study the signal detection problem against sparse alternatives, for known sparsity $s$. Namely, we characterize how large $\epsilon^*>0$ should be, in order to distinguish with high probability the null hypothesis $\theta=0$ from the alternative composed of $s$-sparse vectors in $\mathbb R^d$, separated from $0$ in $L^t$ norm ($t \in [1,\infty]$) by at least $\epsilon^*$. We find minimax upper and lower bounds over the minimax separation radius $\epsilon^*$ and prove that they are always matching. We also derive the corresponding minimax tests achieving these bounds. Our results reveal new phase transitions regarding the behavior of $\epsilon^*$ with respect to the level of sparsity, to the $L^t$ metric, and to the heteroscedasticity profile of $\Sigma$. In the case of the Euclidean (i.e. $L^2$) separation, we bridge the remaining gaps in the literature.


title: Dimensional reduction of the Dirac theory

abstract: We perform a reduction from three to two spatial dimensions of the physics of a spin-1/2 fermion coupled to the electromagnetic field, by applying Hadamard's method of descent. We consider first the free case, in which motion is determined by the Dirac equation, and then the coupling with a dynamical electromagnetic field, governed by the Dirac-Maxwell equations. We find that invariance along one spatial direction splits the free Dirac equation in two decoupled theories. On the other hand, a dimensional reduction in the presence of an electromagnetic field provides a more complicated theory in 2+1 dimensions, in which the method of descent is extended by using the covariant derivative. Equations simplify, but decoupling between different physical sectors occurs only if specific classes of solutions are considered.


title: Error bounds for Lie Group representations in quantum mechanics

abstract: We provide state-dependent error bounds for strongly continuous unitary representations of connected Lie groups. That is, we bound the difference of two unitaries applied to a state in terms of the energy with respect to a reference Hamiltonian associated to the representation and a left-invariant metric distance on the group. Our method works for any connected Lie group and the metric is independent of the chosen representation. The approach also applies to projective representations and allows us to provide bounds on the energy constrained diamond norm distance of any suitably continuous channel representation of the group.


title: Empirical Study on Optimizer Selection for Out-of-Distribution Generalization

abstract: Modern deep learning systems do not generalize well when the test data distribution is slightly different to the training data distribution. While much promising work has been accomplished to address this fragility, a systematic study of the role of optimizers and their out-of-distribution generalization performance has not been undertaken. In this study, we examine the performance of popular first-order optimizers for different classes of distributional shift under empirical risk minimization and invariant risk minimization. We address this question for image and text classification using DomainBed, WILDS, and Backgrounds Challenge as testbeds for studying different types of shifts -- namely correlation and diversity shift. We search over a wide range of hyperparameters and examine classification accuracy (in-distribution and out-of-distribution) for over 20,000 models. We arrive at the following findings, which we expect to be helpful for practitioners: i) adaptive optimizers (e.g., Adam) perform worse than non-adaptive optimizers (e.g., SGD, momentum SGD) on out-of-distribution performance. In particular, even though there is no significant difference in in-distribution performance, we show a measurable difference in out-of-distribution performance. ii) in-distribution performance and out-of-distribution performance exhibit three types of behavior depending on the dataset -- linear returns, increasing returns, and diminishing returns. For example, in the training of natural language data using Adam, fine-tuning the performance of in-distribution performance does not significantly contribute to the out-of-distribution generalization performance.


title: Toward expanding the scope of radiology report summarization to multiple anatomies and modalities

abstract: Radiology report summarization (RRS) is a growing area of research. Given the Findings section of a radiology report, the goal is to generate a summary (called an Impression section) that highlights the key observations and conclusions of the radiology study. However, RRS currently faces essential limitations.First, many prior studies conduct experiments on private datasets, preventing reproduction of results and fair comparisons across different systems and solutions. Second, most prior approaches are evaluated solely on chest X-rays. To address these limitations, we propose a dataset (MIMIC-RRS) involving three new modalities and seven new anatomies based on the MIMIC-III and MIMIC-CXR datasets. We then conduct extensive experiments to evaluate the performance of models both within and across modality-anatomy pairs in MIMIC-RRS. In addition, we evaluate their clinical efficacy via RadGraph, a factual correctness metric.


title: Cyrus2D base: Source Code Base for RoboCup 2D Soccer Simulation League

abstract: Soccer Simulation 2D League is one of the major leagues of RoboCup competitions. In a Soccer Simulation 2D (SS2D) game, two teams of 11 players and one coach compete against each other. Several base codes have been released for the RoboCup soccer simulation 2D (RCSS2D) community that have promoted the application of multi-agent and AI algorithms in this field. In this paper, we introduce "Cyrus2D Base", which is derived from the base code of the RCSS2D 2021 champion. We merged Gliders2D base V2.6 with the newest version of the Helios base. We applied several features of Cyrus2021 to improve the performance and capabilities of this base alongside a Data Extractor to facilitate the implementation of machine learning in the field. We have tested this base code in different teams and scenarios, and the obtained results demonstrate significant improvements in the defensive and offensive strategy of the team.


title: Bandit Algorithms for Prophet Inequality and Pandora's Box

abstract: The Prophet Inequality and Pandora's Box problems are fundamental stochastic problem with applications in Mechanism Design, Online Algorithms, Stochastic Optimization, Optimal Stopping, and Operations Research. A usual assumption in these works is that the probability distributions of the $n$ underlying random variables are given as input to the algorithm. Since in practice these distributions need to be learned, we initiate the study of such stochastic problems in the Multi-Armed Bandits model. In the Multi-Armed Bandits model we interact with $n$ unknown distributions over $T$ rounds: in round $t$ we play a policy $x^{(t)}$ and receive a partial (bandit) feedback on the performance of $x^{(t)}$. The goal is to minimize the regret, which is the difference over $T$ rounds in the total value of the optimal algorithm that knows the distributions vs. the total value of our algorithm that learns the distributions from the partial feedback. Our main results give near-optimal $\tilde{O}(\mathsf{poly}(n)\sqrt{T})$ total regret algorithms for both Prophet Inequality and Pandora's Box. Our proofs proceed by maintaining confidence intervals on the unknown indices of the optimal policy. The exploration-exploitation tradeoff prevents us from directly refining these confidence intervals, so the main technique is to design a regret upper bound that is learnable while playing low-regret Bandit policies.


title: A family of adverse pressure gradient turbulent boundary layers with upstream favorable pressure gradients

abstract: A flat plate turbulent boundary layer (TBL) is experimentally subjected to a family of 22 favorable-adverse pressure gradients (FAPGs) by using a ceiling panel of variable convex curvature. We define a FAPG as a sequence of streamwise pressure gradients in the order of favorable followed by adverse, similar to the pressure gradient sequence over the suction side of an airfoil. The adverse pressure gradient region of this configuration is studied using particle image velocimetry (PIV) in the streamwise--wall-normal plane. The streamwise mean and Reynolds stresses are presented and discussed in this work. Although favorable and adverse pressure gradients are known to evoke opposing responses from a TBL, the current adverse pressure gradient (APG) that followed a favorable pressure gradient (FPG) was not found to 'reverse' the effect of the FPG. Instead, a complex response that is neither characteristic of a ZPG nor an APG TBL was observed. The Reynolds stresses showed a bimodal structure, with the outer-scaled stresses strengthening along the streamwise direction in $y < ~ 0.2 \delta$ and weakening in $y > ~ 0.2\delta$, where $y$ is the wall-normal coordinate, and $\delta$, the local boundary layer thickness. These were signatures of a new internal layer, previously observed in bump/hill flows, formed due to the pressure gradient sign change from favorable to adverse. The non-typical structure of and trends in the statistics were more significant in the stronger pressure gradient cases, where the stronger upstream FPG seemed to have exerted a stronger influence on the downstream APG. The current dataset with 22 cases provided a well-resolved picture of the breakdown of equilibrium of the ZPG TBL under an FAPG configuration. The statistics for all the cases are included under the ancillary file section.


title: Disentangling Task Relations for Few-shot Text Classification via Self-Supervised Hierarchical Task Clustering

abstract: Few-Shot Text Classification (FSTC) imitates humans to learn a new text classifier efficiently with only few examples, by leveraging prior knowledge from historical tasks. However, most prior works assume that all the tasks are sampled from a single data source, which cannot adapt to real-world scenarios where tasks are heterogeneous and lie in different distributions. As such, existing methods may suffer from their globally knowledge-shared mechanisms to handle the task heterogeneity. On the other hand, inherent task relation are not explicitly captured, making task knowledge unorganized and hard to transfer to new tasks. Thus, we explore a new FSTC setting where tasks can come from a diverse range of data sources. To address the task heterogeneity, we propose a self-supervised hierarchical task clustering (SS-HTC) method. SS-HTC not only customizes cluster-specific knowledge by dynamically organizing heterogeneous tasks into different clusters in hierarchical levels but also disentangles underlying relations between tasks to improve the interpretability. Extensive experiments on five public FSTC benchmark datasets demonstrate the effectiveness of SS-HTC.


title: The rainbow saturation number is linear

abstract: Given a graph $H$, we say that an edge-coloured graph $G$ is $H$-rainbow saturated if it does not contain a rainbow copy of $H$, but the addition of any non-edge in any colour creates a rainbow copy of $H$. The rainbow saturation number $\text{rsat}(n,H)$ is the minimum number of edges among all $H$-rainbow saturated edge-coloured graphs on $n$ vertices. We prove that for any non-empty graph $H$, the rainbow saturation number is linear in $n$, thus proving a conjecture of Gir\~{a}o, Lewis, and Popielarz. In addition, we also give an improved upper bound on the rainbow saturation number of the complete graph, disproving a second conjecture of Gir\~{a}o, Lewis, and Popielarz.


title: Dark Matter or Regular Matter in Neutron Stars? How to tell the difference from the coalescence of compact objects

abstract: The mirror twin Higgs model is a candidate for (strongly-interacting) complex dark matter, which mirrors SM interactions with heavier quark masses. A consequence of this model are mirror neutron stars -- exotic stars made entirely of mirror matter, which are significantly smaller than neutron stars and electromagnetically dark. This makes mergers of two mirror neutron stars detectable and distinguishable in gravitational wave observations, but can we observationally distinguish between regular neutron stars and those that may contain some mirror matter? This is the question we study in this paper, focusing on two possible realizations of mirror matter coupled to standard model matter within a compact object: (i) mirror matter captured by a neutron star and (ii) mirror neutron star-neutron star coalescences. Regarding (i), we find that (non-rotating) mirror-matter-admixed neutron stars no longer have a single mass-radius sequence, but rather exist in a two-dimensional mass-radius plane. Regarding (ii), we find that binary systems with mirror neutron stars would span a much wider range of chirp masses and completely different binary Love relations, allowing merger remnants to be very light black holes. The implications of this are that gravitational wave observations with advanced LIGO and Virgo, and X-ray observations with NICER, could detect or constrain the existence of mirror matter through searches with wider model and parameter priors.


title: Exploring Supervised Machine Learning for Multi-Phase Identification and Quantification from Powder X-Ray Diffraction Spectra

abstract: Powder X-ray diffraction analysis is a critical component of materials characterization methodologies. Discerning characteristic Bragg intensity peaks and assigning them to known crystalline phases is the first qualitative step of evaluating diffraction spectra. Subsequent to phase identification, Rietveld refinement may be employed to extract the abundance of quantitative, material-specific parameters hidden within powder data. These characterization procedures are yet time-consuming and inhibit efficiency in materials science workflows. The ever-increasing popularity and propulsion of data science techniques has provided an obvious solution on the course towards materials analysis automation. Deep learning has become a prime focus for predicting crystallographic parameters and features from X-ray spectra. However, the infeasibility of curating large, well-labelled experimental datasets means that one must resort to a large number of theoretic simulations for powder data augmentation to effectively train deep models. Herein, we are interested in conventional supervised learning algorithms in lieu of deep learning for multi-label crystalline phase identification and quantitative phase analysis for a biomedical application. First, models were trained using very limited experimental data. Further, we incorporated simulated XRD data to assess model generalizability as well as the efficacy of simulation-based training for predictive analysis in a real-world X-ray diffraction application.


title: Effects of supra-arcade downflows interacting with the post-flare arcade

abstract: Supra-arcade downflows (SADs) are dark voids descending through plasma above the post-flare arcade. Although they are generally viewed as byproducts of flare reconnections in the corona, the nature of SADs is under debate. Here we investigated six distinct episodes of SADs observed in the post-maximum phase of an M-class flare of April 11, 2013. Differential emission measure analysis revealed that SAD cases occurring close to the flare maximum contain an enhanced hot plasma component at 5--7~MK whereas those occurring later exhibited a depression in hot plasma at 7--12~MK compared to the ambient supra-arcade plasma. On-disk location of the flare enabled us to examine in detail the interaction of SADs with the post-flare arcade, whose effects include 1) transverse oscillations of period $\sim\,$160~s in the supra-arcade rays in the wake of voids, 2) footpoint brightening in 1700{~\AA} whose peak is delayed by 22-46~s with respect to the SAD's arrival at the top of the arcade, and 3) EUV intensity perturbations expanding and propagating with a speed $\sim\,$400 km~s$^{-1}$. On the other hand, due to line-of-sight confusion in the optically thin corona, the ribbon enhancement following the interaction produces an illusion of plasma rebound at the top of the arcade, where the interaction fails to yield significant plasma heating. These effects indicate that the interaction mainly generates MHD waves propagating toward the surface, which may further produce quasi-periodic brightening at flare ribbons, therefore contributing to quasi-periodic flare gradual phase emission in EUV.


title: Composite Consensus-Building Process: Permissible Meeting Analysis and Compromise Choice Exploration

abstract: In solving today's social issues, it is necessary to determine solutions that are acceptable to all stakeholders and collaborate to apply them. The conventional technology of "permissive meeting analysis" derives a consensusable choice that falls within everyone's permissible range through mathematical analyses; however, it tends to be biased toward the majority in a group, making it difficult to reach a consensus when a conflict arises. To support consensus building (defined here as an acceptable compromise that not everyone rejects), we developed a composite consensus-building process. The developed process addresses this issue by combining permissible meeting analysis with a new "compromise choice-exploration" technology, which presents a consensusable choice that emphasizes fairness and equality among everyone when permissible meeting analysis fails to do so. When both permissible meeting analysis and compromise choice exploration do not arrive at a consensus, a facility is provided to create a sublated choice among those provided by them. The trial experimental results confirmed that permissive meeting analysis and compromise choice exploration are sufficiently useful for deriving consensusable choices. Furthermore, we found that compromise choice exploration is characterized by its ability to derive choices that control the balance between compromise and fairness. Our proposed composite consensus-building approach could be applied in a wide range of situations, from local issues in municipalities and communities to international issues such as environmental protection and human rights issues. It could also aid in developing digital democracy and platform cooperativism.


title: Orthogonal Polynomials Approximation Algorithm (OPAA):a functional analytic approach to estimating probability densities

abstract: We present the new Orthogonal Polynomials Approximation Algorithm (OPAA), a parallelizable algorithm that estimates probability distributions using functional analytic approach: first, it finds a smooth functional estimate of the probability distribution, whether it is normalized or not; second, the algorithm provides an estimate of the normalizing weight; and third, the algorithm proposes a new computation scheme to compute such estimates. A core component of OPAA is a special transform of the square root of the joint distribution into a special functional space of our construct. Through this transform, the evidence is equated with the $L^2$ norm of the transformed function, squared. Hence, the evidence can be estimated by the sum of squares of the transform coefficients. Computations can be parallelized and completed in one pass. OPAA can be applied broadly to the estimation of probability density functions. In Bayesian problems, it can be applied to estimating the normalizing weight of the posterior, which is also known as the evidence, serving as an alternative to existing optimization-based methods.


title: Continuity of Powerspaces Structures in Directed Spaces

abstract: Powerspaces of directed spaces play an important role in modeling the semantics of nondeterministic functional programming languages. The notions of upper,lower and convex powerspace of a directed space are defined by the way of free algebras[25]. In this paper, We study the continuity of power structures of directed spaces and show that the directed lower powerspaces, directed upper powerspaces and directed convex powerspaces of continuous spaces are continuous spaces.


title: Theta correspondence and Arthur packets: on the Adams conjecture

abstract: The Adams conjecture predicts that the local theta correspondence should respect Arthur packets. In this paper, we revisit the Adams conjecture for the symplectic--even orthogonal dual pair. Our results provide a precise description of all situations in which the conjecture holds.


title: SketchySGD: Reliable Stochastic Optimization via Randomized Curvature Estimates

abstract: SketchySGD improves upon existing stochastic gradient methods in machine learning by using randomized low-rank approximations to the subsampled Hessian and by introducing an automated stepsize that works well across a wide range of convex machine learning problems. We show theoretically that SketchySGD with a fixed stepsize converges linearly to a small ball around the optimum. Further, in the ill-conditioned setting we show SketchySGD converges at a faster rate than SGD for least-squares problems. We validate this improvement empirically with ridge regression experiments on real data. Numerical experiments on both ridge and logistic regression problems with dense and sparse data, show that SketchySGD equipped with its default hyperparameters can achieve comparable or better results than popular stochastic gradient methods, even when they have been tuned to yield their best performance. In particular, SketchySGD is able to solve an ill-conditioned logistic regression problem with a data matrix that takes more than $840$GB RAM to store, while its competitors, even when tuned, are unable to make any progress. SketchySGD's ability to work out-of-the box with its default hyperparameters and excel on ill-conditioned problems is an advantage over other stochastic gradient methods, most of which require careful hyperparameter tuning (especially of the learning rate) to obtain good performance and degrade in the presence of ill-conditioning.


title: Compatible director fields in $\mathbb{R}^3$

abstract: The geometry and interactions between the constituents of a liquid crystal, which are responsible for inducing the partial order in the fluid, may locally favor an attempted phase that could not be realized in $\mathbb{R}^3$. While states that are incompatible with the geometry of $\mathbb{R}^3$ were identified more than 50 years ago, the collection of compatible states remained poorly understood and not well characterized. Recently, the compatibility conditions for three-dimensional director fields were derived using the method of moving frames. These compatibility conditions take the form of six differential relations in five scalar fields locally characterizing the director field. In this work, we rederive these equations using a more transparent approach employing vector calculus. We then use these equations to characterize a wide collection of compatible phases.


title: Camera simulation for robot simulation: how important are various camera model components?

abstract: Modeling cameras for the simulation of autonomous robotics is critical for generating synthetic images with appropriate realism to effectively evaluate a perception algorithm in simulation. In many cases though, simulated images are produced by traditional rendering techniques that exclude or superficially handle processing steps and aspects encountered in the actual camera pipeline. The purpose of this contribution is to quantify the degree to which the exclusion from the camera model of various image generation steps or aspects affect the sim-to-real gap in robotics. We investigate what happens if one ignores aspects tied to processes from within the physical camera, e.g., lens distortion, noise, and signal processing; scene effects, e.g., lighting and reflection; and rendering quality. The results of the study demonstrate, quantitatively, that large-scale changes to color, scene, and location have far greater impact than model aspects concerned with local, feature-level artifacts. Moreover, we show that these scene-level aspects can stem from lens distortion and signal processing, particularly when considering white-balance and auto-exposure modeling.


title: Connected and Integrated Transportation Systems

abstract: The article provides an overview of the latest developments on control approaches for connected and automated vehicles along with their effectiveness on energy and transportation efficiency.


title: Experimental Guesswork with Quantum Side Information using Twisted Light

abstract: The guesswork is an information-theoretic quantity which can be seen as an alternate security criterion to entropy. Recent work has established the theoretical framework for guesswork in the presence of quantum side information, which we extend both theoretically and experimentally. We consider guesswork when the side information consists of the BB84 states and their higher-dimensional generalizations. With this side information, we compute the guesswork for two different scenarios for each dimension. We then perform a proof-of-principle experiment using Laguerre-Gauss modes to experimentally compute the guesswork for higher-dimensional generalizations of the BB84 states. We find that our experimental results agree closely with our theoretical predictions. This work shows that guesswork can be a viable security criterion in cryptographic tasks, and is experimentally accessible across a number of optical setups.


title: Multi-frequency VLBI Observations of the M 84 Inner Jet/Counterjet

abstract: Observational studies of inner-most regions of the edge-on jets in nearby active galactic nuclei (AGN) are crucial to understand their kinematics and morphology. For the inner jet of the nearby low luminosity AGN in M 84, we present new high-sensitivity observations with very long baseline interferometry since 2019, as well as archival Very Long Baseline Array observations in 2014. We find that the compact core in M 84 has an inverted-to-flat spectrum from 1.5 to 88 GHz. Based on the turnover frequency of $4.2\pm 0.2$ GHz in the spectrum, we estimated a magnetic field strength of 1-10mG and an electron number density of $\sim 10^5 cm^{-3}$ in the core region. Three inner jet components within $\sim 3$ mas from the core are identified and traced in the images at 22 GHz, whose apparent speeds are 0.11 c, 0.27 c, and 0.32 c, respectively. We calculate the viewing angle of $\sim58$ degree for the inner jet based on the proper motion and the flux ratio of jet-to-counterjet. A propagating sinusoidal model with a wavelength of $\sim 3.4$ mas is used to fit the helical morphology of the jet extended to 20 mas ($\sim 2.2\times 10^4$ Schwarzschild Radii).


title: Asynchronous Bayesian Learning over a Network

abstract: We present a practical asynchronous data fusion model for networked agents to perform distributed Bayesian learning without sharing raw data. Our algorithm uses a gossip-based approach where pairs of randomly selected agents employ unadjusted Langevin dynamics for parameter sampling. We also introduce an event-triggered mechanism to further reduce communication between gossiping agents. These mechanisms drastically reduce communication overhead and help avoid bottlenecks commonly experienced with distributed algorithms. In addition, the reduced link utilization by the algorithm is expected to increase resiliency to occasional link failure. We establish mathematical guarantees for our algorithm and demonstrate its effectiveness via numerical experiments.


title: PU GNN: Chargeback Fraud Detection in P2E MMORPGs via Graph Attention Networks with Imbalanced PU Labels

abstract: The recent advent of play-to-earn (P2E) systems in massively multiplayer online role-playing games (MMORPGs) has made in-game goods interchangeable with real-world values more than ever before. The goods in the P2E MMORPGs can be directly exchanged with cryptocurrencies such as Bitcoin, Ethereum, or Klaytn via blockchain networks. Unlike traditional in-game goods, once they had been written to the blockchains, P2E goods cannot be restored by the game operation teams even with chargeback fraud such as payment fraud, cancellation, or refund. To tackle the problem, we propose a novel chargeback fraud prediction method, PU GNN, which leverages graph attention networks with PU loss to capture both the players' in-game behavior with P2E token transaction patterns. With the adoption of modified GraphSMOTE, the proposed model handles the imbalanced distribution of labels in chargeback fraud datasets. The conducted experiments on three real-world P2E MMORPG datasets demonstrate that PU GNN achieves superior performances over previously suggested methods.


title: A Dichotomy Theorem for Linear Time Homomorphism Orbit Counting in Bounded Degeneracy Graphs

abstract: Counting the number of homomorphisms of a pattern graph H in a large input graph G is a fundamental problem in computer science. There are myriad applications of this problem in databases, graph algorithms, and network science. Often, we need more than just the total count. Especially in large network analysis, we wish to compute, for each vertex v of G, the number of H-homomorphisms that v participates in. This problem is referred to as homomorphism orbit counting, as it relates to the orbits of vertices of H under its automorphisms. Given the need for fast algorithms for this problem, we study when near-linear time algorithms are possible. A natural restriction is to assume that the input graph G has bounded degeneracy, a commonly observed property in modern massive networks. Can we characterize the patterns H for which homomorphism orbit counting can be done in linear time? We discover a dichotomy theorem that resolves this problem. For pattern H, let l be the length of the longest induced path between any two vertices of the same orbit (under the automorphisms of H). If l <= 5, then H-homomorphism orbit counting can be done in linear time for bounded degeneracy graphs. If l > 5, then (assuming fine-grained complexity conjectures) there is no near-linear time algorithm for this problem. We build on existing work on dichotomy theorems for counting the total H-homomorphism count. Somewhat surprisingly, there exist (and we characterize) patterns H for which the total homomorphism count can be computed in linear time, but the corresponding orbit counting problem cannot be done in near-linear time.


title: Heat kernel estimates for Dirichlet forms degenerate at the boundary

abstract: The goal of this paper is to prove the existence of heat kernels for two types of purely discontinuous symmetric Markov processes in the upper half-space of $\mathbb R^d$ with jump kernels degenerate at the boundary, and to establish sharp two-sided estimates on the heat kernels. The jump kernels are of the form $J(x,y)=\mathcal B(x,y)|x-y|^{-\alpha-d}$, $\alpha\in (0,2)$, where the function $\mathcal B$ depends on four parameters and may vanish at the boundary. Our results are the first sharp two-sided estimates for the heat kernels of non-local operators with jump kernels degenerate at the boundary. The first type of processes we consider are conservative Markov processes on the closed half-space with jump kernel $J(x,y)$. Depending on the regions where the parameters belong, the heat kernels estimates have three different forms, two of them are qualitatively different from all previously known heat kernel estimates. The second type of processes we consider are the processes above killed either by a critical potential or upon hitting the boundary of the half-space. We establish that their heat kernel estimates have the approximate factorization property with survival probabilities decaying as a power of the distance to the boundary, where the power depends on the constant in the critical potential. Finally, by using the heat kernel estimates, we obtain sharp two-sided Green function estimates that cover the main result of [31]. This alternative proof provides an explanation of the anomalous form of the estimates.


title: Off-Shell Strings I: S-matrix and Action

abstract: We explain why Tseytlin's off-shell formulation of string theory is well-defined. Although quantizing strings on an off-shell background requires an arbitrary choice of Weyl frame, this choice is not physically significant since it can be absorbed into a field redefinition of the target space fields. The off-shell formalism is particularly subtle at tree-level, due to the treatment of the noncompact conformal Killing group SL(2,$\mathbb{C}$) of the sphere. We prove that Tseytlin's sphere prescriptions recover the standard tree-level Lorentzian S-matrix, and show how to extract the stringy $i\varepsilon$ prescription from the UV cutoff on the worldsheet. We also demonstrate that the correct tree-level equations of motion are obtained to all orders in perturbation theory in $g_s$ and $\alpha^{\prime}$, and illuminate the close connection between the string action and the c-theorem.


title: LightDepth: A Resource Efficient Depth Estimation Approach for Dealing with Ground Truth Sparsity via Curriculum Learning

abstract: Advances in neural networks enable tackling complex computer vision tasks such as depth estimation of outdoor scenes at unprecedented accuracy. Promising research has been done on depth estimation. However, current efforts are computationally resource-intensive and do not consider the resource constraints of autonomous devices, such as robots and drones. In this work, we present a fast and battery-efficient approach for depth estimation. Our approach devises model-agnostic curriculum-based learning for depth estimation. Our experiments show that the accuracy of our model performs on par with the state-of-the-art models, while its response time outperforms other models by 71%. All codes are available online at https://github.com/fatemehkarimii/LightDepth.


title: R-Pred: Two-Stage Motion Prediction Via Tube-Query Attention-Based Trajectory Refinement

abstract: Predicting the future motion of dynamic agents is of paramount importance to ensuring safety and assessing risks in motion planning for autonomous robots. In this study, we propose a two-stage motion prediction method, called R-Pred, designed to effectively utilize both scene and interaction context using a cascade of the initial trajectory proposal and trajectory refinement networks. The initial trajectory proposal network produces M trajectory proposals corresponding to the M modes of the future trajectory distribution. The trajectory refinement network enhances each of the M proposals using 1) tube-query scene attention (TQSA) and 2) proposal-level interaction attention (PIA) mechanisms. TQSA uses tube-queries to aggregate local scene context features pooled from proximity around trajectory proposals of interest. PIA further enhances the trajectory proposals by modeling inter-agent interactions using a group of trajectory proposals selected by their distances from neighboring agents. Our experiments conducted on Argoverse and nuScenes datasets demonstrate that the proposed refinement network provides significant performance improvements compared to the single-stage baseline and that R-Pred achieves state-of-the-art performance in some categories of the benchmarks.


title: CoNFies: Controllable Neural Face Avatars

abstract: Neural Radiance Fields (NeRF) are compelling techniques for modeling dynamic 3D scenes from 2D image collections. These volumetric representations would be well suited for synthesizing novel facial expressions but for two problems. First, deformable NeRFs are object agnostic and model holistic movement of the scene: they can replay how the motion changes over time, but they cannot alter it in an interpretable way. Second, controllable volumetric representations typically require either time-consuming manual annotations or 3D supervision to provide semantic meaning to the scene. We propose a controllable neural representation for face self-portraits (CoNFies), that solves both of these problems within a common framework, and it can rely on automated processing. We use automated facial action recognition (AFAR) to characterize facial expressions as a combination of action units (AU) and their intensities. AUs provide both the semantic locations and control labels for the system. CoNFies outperformed competing methods for novel view and expression synthesis in terms of visual and anatomic fidelity of expressions.


title: Probing the Low-mass End of the Black Hole Mass Function via a Study of Faint Local Spiral Galaxies

abstract: We present an analysis of the pitch angle distribution function (PADF) for nearby galaxies and its resulting black hole mass function (BHMF) via the well-known relationship between pitch angle and black hole mass. Our sample consists of a subset of 74 spiral galaxies from the Carnegie-Irvine Galaxy Survey with absolute $B$-band magnitude $\mathfrak{M}_{B}>-19.12$ mag and luminosity distance $D_{\mathrm{L}} \leq 25.4$ Mpc, which is an extension of a complementary set of 140 more luminous ($\mathfrak{M}_{B}\leq-19.12$ mag) late-type galaxies. We find the PADFs of the two samples are, somewhat surprisingly, not strongly dissimilar; a result that may hold important implications for spiral formation theories. Our data show a distinct bimodal population manifest in the pitch angles of the Sa-Sc types and separately the Scd-Sm types, with Sa-Sc types having tighter spiral arms on average. Importantly, we uncover a distinct bifurcation of the BHMF, such that the Sa-Sc galaxies typically host so-called "supermassive" black holes ($M_{\bullet}\gtrsim10^6\,\mathrm{M_{\odot}}$), whereas Scd-Sm galaxies accordingly harbor black holes that are "less-than-supermassive" ($M_{\bullet}\lesssim10^6\,\mathrm{M_{\odot}}$). It is amongst this latter population of galaxies where we expect fruitful bounties of elusive intermediate-mass black holes (IMBHs), through which a better understanding will help form more precise benchmarks for future generations of gravitational wave detectors.


title: Large-scale Atomistic Simulation of Quantum Effects in SrTiO$_3$ from First Principles

abstract: Quantum effects of lattice vibration play a major role in many physical properties of condensed matter systems, including thermal properties such as specific heat, structural phase transition, as well as phenomena such as quantum crystal and quantum paraelectricity that are closely related to zero-point fluctuations. However, realizing atomistic simulations for realistic materials with a fully quantum-mechanical description remains a great challenge. Here, we propose a first-principle strategy for large scale Molecular Dynamics simulation, where high accuracy force field obtained by Deep-Potential (DP) is combined with Quantum Thermal Bath (QTB) method to account for quantum effects. We demonstrate the power of this DP+QTB method using the archetypal example SrTiO$_3$, which exhibits several phenomena induced by quantum fluctuations, such as the suppressed structure phase transition temperature, the quantum paraelectric ground state at low temperature and the quantum critical behavior $1/T^2$ law of dielectric constant. Our DP+QTB strategy is efficient in simulating large scale system, and is first principle. More importantly, quantum effects of other systems could also be investigated as long as corresponding DP model is trained. This strategy would greatly enrich our vision and means to study quantum behavior of condensed matter physics.


title: Enabling self-induced back-action trapping of gold nanoparticles in metamaterial plasmonic tweezers

abstract: The pursuit for efficient nanoparticle trapping with low powers has led to optical tweezers technology moving from the conventional free-space configuration to advanced plasmonic tweezers systems. However, trapping nanoparticles smaller than 10 nm still remains a challenge even for plasmonic tweezers. Proper nanocavity design and excitation has given rise to the self-induced back-action (SIBA) effect offering enhanced trapping stiffness with decreased laser power. In this work, we investigate the SIBA effect in metamaterial tweezers and its synergy with the exhibited Fano resonance. We demonstrate stable trapping of 20 nm gold particles for on-resonant and off-resonant conditions with experimental trap stiffnesses as high as 4.18 fN/(nm*mW/$\mu$m$^2$ and very low excitation intensity of about 1 mW/$\mu$m$^2$. Simulations reveal the existence of two different groups of hotspots per unit cell of the metamaterial array. The two hotspots exhibit tunable trap stiffnesses and this is a unique feature of these systems. It can allow for sorting of particles and biological molecules based on their size, shape, and refractive index.


title: H2-Golden-Retriever: Methodology and Tool for an Evidence-Based Hydrogen Research Grantsmanship

abstract: Hydrogen is poised to play a major role in decarbonizing the economy. The need to discover, develop, and understand low-cost, high-performance, durable materials that can help maximize the cost of electrolysis as well as the need for an intelligent tool to make evidence-based Hydrogen research funding decisions relatively easier warranted this study.In this work, we developed H2 Golden Retriever (H2GR) system for Hydrogen knowledge discovery and representation using Natural Language Processing (NLP), Knowledge Graph and Decision Intelligence. This system represents a novel methodology encapsulating state-of-the-art technique for evidence-based research grantmanship. Relevant Hydrogen papers were scraped and indexed from the web and preprocessing was done using noise and stop-words removal, language and spell check, stemming and lemmatization. The NLP tasks included Named Entity Recognition using Stanford and Spacy NER, topic modeling using Latent Dirichlet Allocation and TF-IDF. The Knowledge Graph module was used for the generation of meaningful entities and their relationships, trends and patterns in relevant H2 papers, thanks to an ontology of the hydrogen production domain. The Decision Intelligence component provides stakeholders with a simulation environment for cost and quantity dependencies. PageRank algorithm was used to rank papers of interest. Random searches were made on the proposed H2GR and the results included a list of papers ranked by relevancy score, entities, graphs of relationships between the entities, ontology of H2 production and Causal Decision Diagrams showing component interactivity. Qualitative assessment was done by the experts and H2GR is deemed to function to a satisfactory level.


title: GLFF: Global and Local Feature Fusion for AI-synthesized Image Detection

abstract: With the rapid development of deep generative models (such as Generative Adversarial Networks and Diffusion models), AI-synthesized images are now of such high quality that humans can hardly distinguish them from pristine ones. Although existing detection methods have shown high performance in specific evaluation settings, e.g., on images from seen models or on images without real-world post-processing, they tend to suffer serious performance degradation in real-world scenarios where testing images can be generated by more powerful generation models or combined with various post-processing operations. To address this issue, we propose a Global and Local Feature Fusion (GLFF) framework to learn rich and discriminative representations by combining multi-scale global features from the whole image with refined local features from informative patches for AI synthesized image detection. GLFF fuses information from two branches: the global branch to extract multi-scale semantic features and the local branch to select informative patches for detailed local artifacts extraction. Due to the lack of a synthesized image dataset simulating real-world applications for evaluation, we further create a challenging fake image dataset, named DeepFakeFaceForensics (DF 3 ), which contains 6 state-of-the-art generation models and a variety of post-processing techniques to approach the real-world scenarios. Experimental results demonstrate the superiority of our method to the state-of-the-art methods on the proposed DF 3 dataset and three other open-source datasets.


title: Integral Zariski dense surface groups in $\operatorname{SL}(n,\mathbf{R})$

abstract: Given a number field $K$, we show that certain $K$-integral representations of closed surface groups can be deformed to being Zariski dense while preserving many useful properties of the original representation. This generalizes a method due to Long and Thistlethwaite who used it to show that thin surface groups in $\operatorname{SL}(2k+1,\mathbf{Z})$ exist for all $k$.


title: Reversible Transformation between Isolated Skyrmions and Bimerons

abstract: Skyrmions and bimerons are versatile topological spin textures that can be used as information bits for both classical and quantum computing. The transformation between isolated skyrmions and bimerons is an essential operation for computing architecture based on multiple different topological bits. Here we report the creation of isolated skyrmions and their subsequent transformation to bimerons by harnessing the electric current-induced Oersted field and temperature-induced perpendicular magnetic anisotropy variation. The transformation between skyrmions and bimerons is reversible, which is controlled by the current amplitude and scanning direction. Both skyrmions and bimerons can be created in the same system through the skyrmion-bimeron transformation and magnetization switching. Deformed skyrmion bubbles and chiral labyrinth domains are found as nontrivial intermediate transition states. Our results may provide a unique way for building advanced information-processing devices using different types of topological spin textures in the same system.


title: The combinatorial code and the graph rules of Dale networks

abstract: We describe the combinatorics of equilibria and steady states of neurons in threshold-linear networks that satisfy Dale's law. The combinatorial code of a Dale network is characterized in terms of two conditions: (i) a condition on the network connectivity graph, and (ii) a spectral condition on the synaptic matrix. We find that in the weak coupling regime the combinatorial code depends only on the connectivity graph, and not on the particulars of the synaptic strengths. Moreover, we prove that the combinatorial code of a weakly coupled network is a sublattice, and we provide a learning rule for encoding a sublattice in a weakly coupled excitatory network. In the strong coupling regime we prove that the combinatorial code of a generic Dale network is intersection-complete and is therefore a convex code, as is common in some sensory systems in the brain.


title: Wellfoundedness proof with the maximal distinguished set

abstract: In arXiv:2208.12944 it is shown that an ordinal $\sup_{N<\omega}\psi_{\Omega_{1}}(\varepsilon_{\Omega_{\mathbb{S}+N}+1})$ is an upper bound for the proof-theoretic ordinal of a set theory ${\sf KP}\ell^{r}+(M\prec_{\Sigma_{1}}V)$. In this paper we show that a second order arithmetic $\Sigma^{1-}_{2}\mbox{-CA}+\Pi^{1}_{1}\mbox{-CA}_{0}$ proves the wellfoundedness up to $\psi_{\Omega_{1}}(\varepsilon_{\Omega_{\mathbb{S}+N+1}})$ for each $N$. It is easy to interpret $\Sigma^{1-}_{2}\mbox{-CA}+\Pi^{1}_{1}\mbox{-CA}_{0}$ in ${\sf KP}\ell^{r}+(M\prec_{\Sigma_{1}}V)$.