title: A lattice model with Fibonacci degree of degeneracy

abstract: In this paper, we explore two different methods of finding the degrees of degeneracy for lattice model systems, specifically constructing one with a Fibonacci degree of degeneracy. We also calculate the number of ground states per site as the golden ratio $(\phi)$ for the system that we constructed and extend our results to systems with $k-$Step Fibonacci degrees of degeneracy. Finally, I end with a few open questions that we may examine for future works.


title: Flow Dynamics Correction for Action Recognition

abstract: Various research studies indicate that action recognition performance highly depends on the types of motions being extracted and how accurate the human actions are represented. In this paper, we investigate different optical flow, and features extracted from these optical flow that capturing both short-term and long-term motion dynamics. We perform power normalization on the magnitude component of optical flow for flow dynamics correction to boost subtle or dampen sudden motions. We show that existing action recognition models which rely on optical flow are able to get performance boosted with our corrected optical flow. To further improve performance, we integrate our corrected flow dynamics into popular models through a simple hallucination step by selecting only the best performing optical flow features, and we show that by 'translating' the CNN feature maps into these optical flow features with different scales of motions leads to the new state-of-the-art performance on several benchmarks including HMDB-51, YUP++, fine-grained action recognition on MPII Cooking Activities, and large-scale Charades.


title: Data Augmentation for Time-Series Classification: An Extensive Empirical Study and Comprehensive Survey

abstract: Data Augmentation (DA) has emerged as an indispensable strategy in Time Series Classification (TSC), primarily due to its capacity to amplify training samples, thereby bolstering model robustness, diversifying datasets, and curtailing overfitting. However, the current landscape of DA in TSC is plagued with fragmented literature reviews, nebulous methodological taxonomies, inadequate evaluative measures, and a dearth of accessible, user-oriented tools. In light of these challenges, this study embarks on an exhaustive dissection of DA methodologies within the TSC realm. Our initial approach involved an extensive literature review spanning a decade, revealing that contemporary surveys scarcely capture the breadth of advancements in DA for TSC, prompting us to meticulously analyze over 100 scholarly articles to distill more than 60 unique DA techniques. This rigorous analysis precipitated the formulation of a novel taxonomy, purpose-built for the intricacies of DA in TSC, categorizing techniques into five principal echelons: Transformation-Based, Pattern-Based, Generative, Decomposition-Based, and Automated Data Augmentation. Our taxonomy promises to serve as a robust navigational aid for scholars, offering clarity and direction in method selection. Addressing the conspicuous absence of holistic evaluations for prevalent DA techniques, we executed an all-encompassing empirical assessment, wherein upwards of 15 DA strategies were subjected to scrutiny across 8 UCR time-series datasets, employing ResNet and a multi-faceted evaluation paradigm encompassing Accuracy, Method Ranking, and Residual Analysis, yielding a benchmark accuracy of 88.94 +- 11.83%. Our investigation underscored the inconsistent efficacies of DA techniques, with....


title: A computational model of serial and parallel processing in visual search

abstract: The following is a dissertation aimed at understanding what the various phenomena in visual search teach us about the nature of human visual representations and processes. I first review some of the major empirical findings in the study of visual search. I next present a theory of visual search in terms of what I believe these findings suggest about the representations and processes underlying ventral visual processing. These principles are instantiated in a computational model called CASPER (Concurrent Attention: Serial and Parallel Evaluation with Relations), originally developed by Hummel, that I have adapted to account for a range of phenomena in visual search. I then describe an extension of the CASPER model to account for our ability to search for visual items defined not simply by the features composing those items but by the spatial relations among those features. Seven experiments (four main experiments and three replications) are described that test CASPER's predictions about relational search. Finally, I evaluate the fit between CASPER's predictions and the empirical findings and show with three additional simulations that CASPER can account for negative acceleration in search functions for relational stimuli if one postulates that the visual system is leveraging an emergent feature that bypasses relational processing.


title: A Comprehensive Evaluation of Tool-Assisted Generation Strategies

abstract: A growing area of research investigates augmenting language models with tools (e.g., search engines, calculators) to overcome their shortcomings (e.g., missing or incorrect knowledge, incorrect logical inferences). Various few-shot tool-usage strategies have been proposed. However, there is no systematic and fair comparison across different strategies, or between these strategies and strong baselines that do not leverage tools. We conduct an extensive empirical analysis, finding that (1) across various datasets, example difficulty levels, and models, strong no-tool baselines are competitive to tool-assisted strategies, implying that effectively using tools with in-context demonstrations is a difficult unsolved problem; (2) for knowledge-retrieval tasks, strategies that *refine* incorrect outputs with tools outperform strategies that retrieve relevant information *ahead of* or *during generation*; (3) tool-assisted strategies are expensive in the number of tokens they require to work -- incurring additional costs by orders of magnitude -- which does not translate into significant improvement in performance. Overall, our findings suggest that few-shot tool integration is still an open challenge, emphasizing the need for comprehensive evaluations of future strategies to accurately assess their *benefits* and *costs*.


title: 1,1-Diphenyl-2-picrylhydrazyl and superoxide anion radical scavenging 1 activities of heterocyclic 2-oxo-1,2,3,4-tetrahydropyrimidines

abstract: To investigate1,1-Diphenyl-2-picrylhydrazyl (DPPH) and superoxide radical (SOR) 17 scavenging activities of 2-oxo-1,2,3,4-tetrahydropyrimidines derivatives. Free radicals are 18 highly unstable and reactive molecules/atoms. In the body, free radicals form during 19 normal and abnormal metabolism in the body and cause serious damage to other 20 biomolecules through generating oxidative stress (OS). If free radicals induced OS does 21 not neutralized properly, host multiple pathologies including several types of cancers.


title: Shape-aware Graph Spectral Learning

abstract: Spectral Graph Neural Networks (GNNs) are gaining attention for their ability to surpass the limitations of message-passing GNNs. They rely on supervision from downstream tasks to learn spectral filters that capture the graph signal's useful frequency information. However, some works empirically show that the preferred graph frequency is related to the graph homophily level. This relationship between graph frequency and graphs with homophily/heterophily has not been systematically analyzed and considered in existing spectral GNNs. To mitigate this gap, we conduct theoretical and empirical analyses revealing a positive correlation between low-frequency importance and the homophily ratio, and a negative correlation between high-frequency importance and the homophily ratio. Motivated by this, we propose shape-aware regularization on a Newton Interpolation-based spectral filter that can (i) learn an arbitrary polynomial spectral filter and (ii) incorporate prior knowledge about the desired shape of the corresponding homophily level. Comprehensive experiments demonstrate that NewtonNet can achieve graph spectral filters with desired shapes and superior performance on both homophilous and heterophilous datasets.


title: Bridging BRC-20 to Ethereum

abstract: In this paper, we design, implement, and (partially-) evaluate a lightweight bridge (as a type of middleware) to connect the Bitcoin and Ethereum networks that were heterogeneously uncontactable before. Inspired by the recently introduced Bitcoin Request Comment (BRC-20) standard, we leverage the flexibility of Bitcoin inscriptions by embedding editable operations within each satoshi and mapping them to programmable Ethereum smart contracts. A user can initialize his/her requests from the Bitcoin network, subsequently triggering corresponding actions on the Ethereum network. We validate the lightweight nature of our solution and its ability to facilitate secure and seamless interactions between two heterogeneous ecosystems.


title: A search for extragalactic fast optical transients in the Tomo-e Gozen high-cadence survey

abstract: The population of optical transients evolving within a time-scale of a few hours or a day (so-called fast optical transients, FOTs) has recently been debated extensively. In particular, our understanding of extragalactic FOTs and their rates is limited. We present a search for extragalactic FOTs with the Tomo-e Gozen high-cadence survey. Using the data taken from 2019 August to 2022 June, we obtain 113 FOT candidates. Through light curve analysis and cross-matching with other survey data, we find that most of these candidates are in fact supernovae, variable quasars, and Galactic dwarf novae, that were partially observed around their peak brightness. We find no promising candidate of extragalactic FOTs. From this non-detection, we obtain upper limits on the event rate of extragalactic FOTs as a function of their time-scale. For a very luminous event (absolute magnitude $M<-26$ mag), we obtain the upper limits of $4.4 \times 10^{-9}$ Mpc$^{-3}$ yr$^{-1}$ for a time-scale of 4 h, and $7.4 \times 10^{-10}$ Mpc$^{-3}$ yr$^{-1}$ for a time-scale of 1 d. Thanks to our wide (although shallow) surveying strategy, our data are less affected by the cosmological effects, and thus, give one of the more stringent limits to the event rate of intrinsically luminous transients with a time-scale of $< 1$ d.


title: Comparative Study of Planetary Atmospheric Uncertainties and Design Rules for Aerocapture Missions

abstract: Aerocapture uses atmospheric drag to decelerate spacecraft and achieve orbit insertion. One of the significant risks associated with aerocapture is the uncertainty in the atmospheric density, particularly for outer planets. The paper performs a comparative study of the atmospheric uncertainties and provides design rules for aerocapture missions. The atmospheres of Venus, Mars, and Titan are well-characterized for engineering purposes. At the altitude ranges relevant for aerocapture, the 3$\sigma$ density variation is approximately $\pm$30%, $\pm$50%, $\pm$30% for Venus, Mars, and Titan respectively. With no in-situ data, the atmospheres of Uranus and Neptune are not as well characterized as the other bodies. For both Uranus and Neptune, the GRAM suite provides a 3$\sigma$ density variation of approximately $\pm$30% for the relevant altitude ranges which is considered an optimistic estimate. Until in-situ data from an atmospheric probe becomes available, a more conservative global min-max estimate is recommended to accommodate the worst-case scenario. The study presents a graphical method for selection of the optimal entry flight path angle when considering the atmospheric uncertainties to ensure the on-board guidance is given the best possible initial state for targeting the desired exit state post aerocapture.


title: Generalizable Person Search on Open-world User-Generated Video Content

abstract: Person search is a challenging task that involves detecting and retrieving individuals from a large set of un-cropped scene images. Existing person search applications are mostly trained and deployed in the same-origin scenarios. However, collecting and annotating training samples for each scene is often difficult due to the limitation of resources and the labor cost. Moreover, large-scale intra-domain data for training are generally not legally available for common developers, due to the regulation of privacy and public security. Leveraging easily accessible large-scale User Generated Video Contents (\emph{i.e.} UGC videos) to train person search models can fit the open-world distribution, but still suffering a performance gap from the domain difference to surveillance scenes. In this work, we explore enhancing the out-of-domain generalization capabilities of person search models, and propose a generalizable framework on both feature-level and data-level generalization to facilitate downstream tasks in arbitrary scenarios. Specifically, we focus on learning domain-invariant representations for both detection and ReID by introducing a multi-task prototype-based domain-specific batch normalization, and a channel-wise ID-relevant feature decorrelation strategy. We also identify and address typical sources of noise in open-world training frames, including inaccurate bounding boxes, the omission of identity labels, and the absence of cross-camera data. Our framework achieves promising performance on two challenging person search benchmarks without using any human annotation or samples from the target domain.


title: Emergent spin-gapped magnetization plateaus in a spin-1/2 perfect kagome antiferromagnet

abstract: The two-dimensional (2D) spin-1/2 kagome Heisenberg antiferromagnet is believed to host quantum spin liquid (QSL) states with no magnetic order, but its ground state remains largely elusive. An important outstanding question concerns the presence or absence of the 1/9 magnetization plateau, where exotic quantum states, including topological ones, are expected to emerge. Here we report the magnetization of a recently discovered kagome QSL candidate YCu$_3$(OH)$_{6.5}$Br$_{2.5}$ up to 57 T. Above 50 T, a clear magnetization plateau at 1/3 of the saturation moment of Cu$^{2+}$ ions is observed, supporting that this material provides an ideal platform for the kagome Heisenberg antiferromagnet. Remarkably, we found another magnetization plateau around 20 T, which is attributed to the 1/9 plateau. The temperature dependence of this plateau reveals the distinct spin gap, whose magnitude estimated by the plateau width is approximately 10% of the exchange interaction. The observation of 1/9 and 1/3 plateaus highlights the emergence of novel states in quantum spin systems.


title: GreatSplicing: A Semantically Rich Splicing Dataset

abstract: In existing splicing forgery datasets, the insufficient semantic varieties of spliced regions cause a problem that trained detection models overfit semantic features rather than splicing traces. Meanwhile, because of the absence of a reasonable dataset, different detection methods proposed cannot reach a consensus on experimental settings. To address these urgent issues, GreatSplicing, a manually created splicing dataset with a considerable amount and high quality, is proposed in this paper. GreatSplicing comprises 5,000 spliced images and covers spliced regions with 335 distinct semantic categories, allowing neural networks to grasp splicing traces better. Extensive experiments demonstrate that models trained on GreatSplicing exhibit minimal misidentification rates and superior cross-dataset detection capabilities compared to existing datasets. Furthermore, GreatSplicing is available for all research purposes and can be downloaded from www.greatsplicing.net.


title: ZoomTrack: Target-aware Non-uniform Resizing for Efficient Visual Tracking

abstract: Recently, the transformer has enabled the speed-oriented trackers to approach state-of-the-art (SOTA) performance with high-speed thanks to the smaller input size or the lighter feature extraction backbone, though they still substantially lag behind their corresponding performance-oriented versions. In this paper, we demonstrate that it is possible to narrow or even close this gap while achieving high tracking speed based on the smaller input size. To this end, we non-uniformly resize the cropped image to have a smaller input size while the resolution of the area where the target is more likely to appear is higher and vice versa. This enables us to solve the dilemma of attending to a larger visual field while retaining more raw information for the target despite a smaller input size. Our formulation for the non-uniform resizing can be efficiently solved through quadratic programming (QP) and naturally integrated into most of the crop-based local trackers. Comprehensive experiments on five challenging datasets based on two kinds of transformer trackers, \ie, OSTrack and TransT, demonstrate consistent improvements over them. In particular, applying our method to the speed-oriented version of OSTrack even outperforms its performance-oriented counterpart by 0.6% AUC on TNL2K, while running 50% faster and saving over 55% MACs. Codes and models are available at https://github.com/Kou-99/ZoomTrack.


title: Fine-tuning ChatGPT for Automatic Scoring

abstract: This study highlights the potential of fine-tuned ChatGPT (GPT-3.5) for automatically scoring student written constructed responses using example assessment tasks in science education. Recent studies on OpenAI's generative model GPT-3.5 proved its superiority in predicting the natural language with high accuracy and human-like responses. GPT-3.5 has been trained over enormous online language materials such as journals and Wikipedia; therefore, more than direct usage of pre-trained GPT-3.5 is required for automatic scoring as students utilize a different language than trained material. These imply that a domain-specific model, fine-tuned over data for specific tasks, can enhance model performance. In this study, we fine-tuned GPT-3.5 on six assessment tasks with a diverse dataset of middle-school and high-school student responses and expert scoring. The six tasks comprise two multi-label and four multi-class assessment tasks. We compare the performance of fine-tuned GPT-3.5 with the fine-tuned state-of-the-art Google's generated language model, BERT. The results show that in-domain training corpora constructed from science questions and responses for BERT achieved average accuracy = 0.838, SD = 0.069. GPT-3.5 shows a remarkable average increase (9.1%) in automatic scoring accuracy (mean = 9.15, SD = 0.042) for the six tasks, p =0.001 < 0.05. Specifically, for multi-label tasks (item 1 with 5 labels; item 2 with 10 labels), GPT-3.5 achieved significantly higher scoring accuracy than BERT across all the labels, with the second item achieving a 7.1% increase. The average scoring increase for the four multi-class items for GPT-3.5 was 10.6% compared to BERT. Our study confirmed the effectiveness of fine-tuned GPT-3.5 for automatic scoring of student responses on domain-specific data in education with high accuracy. We have released fine-tuned models for public use and community engagement.


title: Expression Domain Translation Network for Cross-domain Head Reenactment

abstract: Despite the remarkable advancements in head reenactment, the existing methods face challenges in cross-domain head reenactment, which aims to transfer human motions to domains outside the human, including cartoon characters. It is still difficult to extract motion from out-of-domain images due to the distinct appearances, such as large eyes. Recently, previous work introduced a large-scale anime dataset called AnimeCeleb and a cross-domain head reenactment model, including an optimization-based mapping function to translate the human domain's expressions to the anime domain. However, we found that the mapping function, which relies on a subset of expressions, imposes limitations on the mapping of various expressions. To solve this challenge, we introduce a novel expression domain translation network that transforms human expressions into anime expressions. Specifically, to maintain the geometric consistency of expressions between the input and output of the expression domain translation network, we employ a 3D geometric-aware loss function that reduces the distances between the vertices in the 3D mesh of the human and anime. By doing so, it forces high-fidelity and one-to-one mapping with respect to two cross-expression domains. Our method outperforms existing methods in both qualitative and quantitative analysis, marking a significant advancement in the field of cross-domain head reenactment.


title: SoTTA: Robust Test-Time Adaptation on Noisy Data Streams

abstract: Test-time adaptation (TTA) aims to address distributional shifts between training and testing data using only unlabeled test data streams for continual model adaptation. However, most TTA methods assume benign test streams, while test samples could be unexpectedly diverse in the wild. For instance, an unseen object or noise could appear in autonomous driving. This leads to a new threat to existing TTA algorithms; we found that prior TTA algorithms suffer from those noisy test samples as they blindly adapt to incoming samples. To address this problem, we present Screening-out Test-Time Adaptation (SoTTA), a novel TTA algorithm that is robust to noisy samples. The key enabler of SoTTA is two-fold: (i) input-wise robustness via high-confidence uniform-class sampling that effectively filters out the impact of noisy samples and (ii) parameter-wise robustness via entropy-sharpness minimization that improves the robustness of model parameters against large gradients from noisy samples. Our evaluation with standard TTA benchmarks with various noisy scenarios shows that our method outperforms state-of-the-art TTA methods under the presence of noisy samples and achieves comparable accuracy to those methods without noisy samples. The source code is available at https://github.com/taeckyung/SoTTA .


title: Dynamical magneto-rotational instability

abstract: Magneto-rotational instability (MRI) is an important instability mechanism for rotating flows with magnetic fields. In particular, when the strength of the magnetic field tends to zero, the stability criterion for rotating flows is generally different from the classical Rayleigh criterion for rotating flows without a magnetic field. MRI has wide applications in astrophysics, particularly to the turbulence and enhanced angular momentum transport in accretion disks. For the case of vertical magnetic fields, we give rigorous proof of linear MRI and a complete description of the spectra and semigroup growth of the linearized operator. Moreover, we prove nonlinear stability and instability from the sharp linear stability/instability criteria.


title: Verbosity Bias in Preference Labeling by Large Language Models

abstract: In recent years, Large Language Models (LLMs) have witnessed a remarkable surge in prevalence, altering the landscape of natural language processing and machine learning. One key factor in improving the performance of LLMs is alignment with humans achieved with Reinforcement Learning from Human Feedback (RLHF), as for many LLMs such as GPT-4, Bard, etc. In addition, recent studies are investigating the replacement of human feedback with feedback from other LLMs named Reinforcement Learning from AI Feedback (RLAIF). We examine the biases that come along with evaluating LLMs with other LLMs and take a closer look into verbosity bias -- a bias where LLMs sometimes prefer more verbose answers even if they have similar qualities. We see that in our problem setting, GPT-4 prefers longer answers more than humans. We also propose a metric to measure this bias.


title: Prompt Packer: Deceiving LLMs through Compositional Instruction with Hidden Attacks

abstract: Recently, Large language models (LLMs) with powerful general capabilities have been increasingly integrated into various Web applications, while undergoing alignment training to ensure that the generated content aligns with user intent and ethics. Unfortunately, they remain the risk of generating harmful content like hate speech and criminal activities in practical applications. Current approaches primarily rely on detecting, collecting, and training against harmful prompts to prevent such risks. However, they typically focused on the "superficial" harmful prompts with a solitary intent, ignoring composite attack instructions with multiple intentions that can easily elicit harmful content in real-world scenarios. In this paper, we introduce an innovative technique for obfuscating harmful instructions: Compositional Instruction Attacks (CIA), which refers to attacking by combination and encapsulation of multiple instructions. CIA hides harmful prompts within instructions of harmless intentions, making it impossible for the model to identify underlying malicious intentions. Furthermore, we implement two transformation methods, known as T-CIA and W-CIA, to automatically disguise harmful instructions as talking or writing tasks, making them appear harmless to LLMs. We evaluated CIA on GPT-4, ChatGPT, and ChatGLM2 with two safety assessment datasets and two harmful prompt datasets. It achieves an attack success rate of 95%+ on safety assessment datasets, and 83%+ for GPT-4, 91%+ for ChatGPT (gpt-3.5-turbo backed) and ChatGLM2-6B on harmful prompt datasets. Our approach reveals the vulnerability of LLMs to such compositional instruction attacks that harbor underlying harmful intentions, contributing significantly to LLM security development. Warning: this paper may contain offensive or upsetting content!


title: Gravitational wave analogues in spin nematics and cold atoms

abstract: Many large-scale phenomena in our Universe, such as gravitational waves, are challenging to reproduce in laboratory settings. However, parallels with condensed matter systems can provide alternative routes for experimental accessibility. Here we show how spin nematic phases provide a low-energy avenue for accessing the physics of linearized gravity, and in particular that their Goldstone modes are relativistically-dispersing massless spin-2 excitations, analogous to gravitational waves. We show at the level of the action that the low-energy effective field theory describing a spin nematic is in correspondence with that of linearized gravity. We then explicitly identify a microscopic model of a spin-1 magnet whose excitations in the low energy limit are relativistically dispersing, massless spin-2 Bosons which are in one-to-one correspondence with gravitational waves and, supported by simulation, outline a procedure for directly observing these analogue waves in a cold gas of $^{23}$Na atoms.


title: MOCHA: Real-Time Motion Characterization via Context Matching

abstract: Transforming neutral, characterless input motions to embody the distinct style of a notable character in real time is highly compelling for character animation. This paper introduces MOCHA, a novel online motion characterization framework that transfers both motion styles and body proportions from a target character to an input source motion. MOCHA begins by encoding the input motion into a motion feature that structures the body part topology and captures motion dependencies for effective characterization. Central to our framework is the Neural Context Matcher, which generates a motion feature for the target character with the most similar context to the input motion feature. The conditioned autoregressive model of the Neural Context Matcher can produce temporally coherent character features in each time frame. To generate the final characterized pose, our Characterizer network incorporates the characteristic aspects of the target motion feature into the input motion feature while preserving its context. This is achieved through a transformer model that introduces the adaptive instance normalization and context mapping-based cross-attention, effectively injecting the character feature into the source feature. We validate the performance of our framework through comparisons with prior work and an ablation study. Our framework can easily accommodate various applications, including characterization with only sparse input and real-time characterization. Additionally, we contribute a high-quality motion dataset comprising six different characters performing a range of motions, which can serve as a valuable resource for future research.


title: Let's reward step by step: Step-Level reward model as the Navigators for Reasoning

abstract: Recent years have seen considerable advancements in multi-step reasoning with Large Language Models (LLMs). The previous studies have elucidated the merits of integrating feedback or search mechanisms during model inference to improve the reasoning accuracy. The Process-Supervised Reward Model (PRM), typically furnishes LLMs with step-by-step feedback during the training phase, akin to Proximal Policy Optimization (PPO) or reject sampling. Our objective is to examine the efficacy of PRM in the inference phase to help discern the optimal solution paths for multi-step tasks such as mathematical reasoning and code generation. To this end, we propose a heuristic greedy search algorithm that employs the step-level feedback from PRM to optimize the reasoning pathways explored by LLMs. This tailored PRM demonstrated enhanced results compared to the Chain of Thought (CoT) on mathematical benchmarks like GSM8K and MATH. Additionally, to explore the versatility of our approach, we develop a novel method to automatically generate step-level reward dataset for coding tasks and observed similar improved performance in the code generation tasks. Thus highlighting the robust nature of our reward-model-based approach to inference for reasoning tasks.


title: Sensing of quantum nonlinear noise correlations via thermodynamic variables

abstract: We put forth the concept of quantum noise sensors based on nonlinear two-mode interferometers coupled to mechanical oscillators. These simple, autonomous machines are capable of a hitherto unexplored quantum thermodynamic functionality: the ability to sense quantum nonlinear correlations of noisy fields via the thermodynamic variable of extractable work. The machines filter thermal noise input and turn it into quantum correlated output. Such nonlinear correlations arise in feasible experimental setups involving Rydberg polaritons coupled via dipole-dipole interactions or cavity modes that exchange quanta via their coupling to multi-level atoms. By monitoring a mechanical oscillator coupled to the interferometer, one can sense the work capacity of one of the interferometer output modes and thereby reveal its quantum nonlinear correlations. The proposed quantum sensing method can provide a much simpler alternative to quantum multiport interferometry supplemented by process tomography.


title: A simple uniformly optimal method without line search for convex optimization

abstract: Line search (or backtracking) procedures have been widely employed into first-order methods for solving convex optimization problems, especially those with unknown problem parameters (e.g., Lipschitz constant). In this paper, we show that line search is superfluous in attaining the optimal rate of convergence for solving a convex optimization problem whose parameters are not given a priori. In particular, we present a novel accelerated gradient descent type algorithm called auto-conditioned fast gradient method (AC-FGM) that can achieve an optimal $\mathcal{O}(1/k^2)$ rate of convergence for smooth convex optimization without requiring the estimate of a global Lipschitz constant or the employment of line search procedures. We then extend AC-FGM to solve convex optimization problems with H\"{o}lder continuous gradients and show that it automatically achieves the optimal rates of convergence uniformly for all problem classes with the desired accuracy of the solution as the only input. Finally, we report some encouraging numerical results that demonstrate the advantages of AC-FGM over the previously developed parameter-free methods for convex optimization.


title: JMedLoRA:Medical Domain Adaptation on Japanese Large Language Models using Instruction-tuning

abstract: In the ongoing wave of impact driven by large language models (LLMs) like ChatGPT, the adaptation of LLMs to medical domain has emerged as a crucial research frontier. Since mainstream LLMs tend to be designed for general-purpose applications, constructing a medical LLM through domain adaptation is a huge challenge. While instruction-tuning is used to fine-tune some LLMs, its precise roles in domain adaptation remain unknown. Here we show the contribution of LoRA-based instruction-tuning to performance in Japanese medical question-answering tasks. In doing so, we employ a multifaceted evaluation for multiple-choice questions, including scoring based on "Exact match" and "Gestalt distance" in addition to the conventional accuracy. Our findings suggest that LoRA-based instruction-tuning can partially incorporate domain-specific knowledge into LLMs, with larger models demonstrating more pronounced effects. Furthermore, our results underscore the potential of adapting English-centric models for Japanese applications in domain adaptation, while also highlighting the persisting limitations of Japanese-centric models. This initiative represents a pioneering effort in enabling medical institutions to fine-tune and operate models without relying on external services.


title: Sectorial covers over fanifolds

abstract: For the stopped Weinstein sector associated with any fanifold recently introduced by Gammage--Shende, we construct a Weinstein sectorial cover which allows us to describe homological mirror symmetry over the fanifold as an isomorphism of cosheaves of categories. In a special case, our Weinstein sectorial cover gives a lift of the open cover for the global skeleton of a very affine hypersurface computed in their previous work.


title: Solution to Advanced Manufacturing Process Problems using Cohort Intelligence Algorithm with Improved Constraint Handling Approaches

abstract: Recently, various Artificial Intelligence (AI) based optimization metaheuristics are proposed and applied for a variety of problems. Cohort Intelligence (CI) algorithm is a socio inspired optimization technique which is successfully applied for solving several unconstrained & constrained real-world problems from the domains such as design, manufacturing, supply chain, healthcare, etc. Generally, real-world problems are constrained in nature. Even though most of the Evolutionary Algorithms (EAs) can efficiently solve unconstrained problems, their performance degenerates when the constraints are involved. In this paper, two novel constraint handling approaches based on modulus and hyperbolic tangent probability distributions are proposed. Constrained CI algorithm with constraint handling approaches based on triangular, modulus and hyperbolic tangent is presented and applied for optimizing advanced manufacturing processes such as Water Jet Machining (WJM), Abrasive Jet Machining (AJM), Ultrasonic Machining (USM) and Grinding process. The solutions obtained using proposed CI algorithm are compared with contemporary algorithms such as Genetic Algorithm, Simulated Annealing, Teaching Learning Based Optimization, etc. The proposed approaches achieved 2%-127% maximization of material removal rate satisfying hard constraints. As compared to the GA, CI with Hyperbolic tangent probability distribution achieved 15%, 2%, 2%, 127%, and 4% improvement in MRR for AJMB, AJMD, WJM, USM, and Grinding processes, respectively contributing to the productivity improvement. The contributions in this paper have opened several avenues for further applicability of the proposed constraint handling approaches for solving complex constrained problems.


title: The effect of electric and chiral magnetic conductivities on azimuthally fluctuating electromagnetic fields and observables in isobar collisions

abstract: We study the space-time evolution of electromagnetic fields along with the azimuthal fluctuations of these fields and their correlation with the initial matter geometry specified by the participant plane in the presence of finite electric $\left(\sigma\right)$ and chiral magnetic $\left(\sigma_{\chi}\right)$ conductivities in Ru+Ru and Zr+Zr collisions at $\sqrt{s_{NN}}=200$ GeV. We observe the partially asymmetric behavior of the spatial distributions of the electric and magnetic fields in a conducting medium when compared to the Lienard-Wiechert (L-W) solutions, and deceleration of the decay of the fields is observed in both isobar collisions. While studying the correlation between the magnetic field direction and the participant plane, we see the sizeable suppression of the correlation in the presence of finite conductivities when compared to the L-W case, reflecting the importance of taking into account the medium properties such as conductivities while calculating the magnetic field induced observable quantities.


title: Hyperbolic knots with a large toroidal surgery

abstract: We show an infinite family of hyperbolic knots that have an exceptional surgery producing a graph manifold containing five disjoint, and non parallel incompressible tori.


title: PUCA: Patch-Unshuffle and Channel Attention for Enhanced Self-Supervised Image Denoising

abstract: Although supervised image denoising networks have shown remarkable performance on synthesized noisy images, they often fail in practice due to the difference between real and synthesized noise. Since clean-noisy image pairs from the real world are extremely costly to gather, self-supervised learning, which utilizes noisy input itself as a target, has been studied. To prevent a self-supervised denoising model from learning identical mapping, each output pixel should not be influenced by its corresponding input pixel; This requirement is known as J-invariance. Blind-spot networks (BSNs) have been a prevalent choice to ensure J-invariance in self-supervised image denoising. However, constructing variations of BSNs by injecting additional operations such as downsampling can expose blinded information, thereby violating J-invariance. Consequently, convolutions designed specifically for BSNs have been allowed only, limiting architectural flexibility. To overcome this limitation, we propose PUCA, a novel J-invariant U-Net architecture, for self-supervised denoising. PUCA leverages patch-unshuffle/shuffle to dramatically expand receptive fields while maintaining J-invariance and dilated attention blocks (DABs) for global context incorporation. Experimental results demonstrate that PUCA achieves state-of-the-art performance, outperforming existing methods in self-supervised image denoising.


title: Over-the-Air Federated Learning and Optimization

abstract: Federated learning (FL), as an emerging distributed machine learning paradigm, allows a mass of edge devices to collaboratively train a global model while preserving privacy. In this tutorial, we focus on FL via over-the-air computation (AirComp), which is proposed to reduce the communication overhead for FL over wireless networks at the cost of compromising in the learning performance due to model aggregation error arising from channel fading and noise. We first provide a comprehensive study on the convergence of AirComp-based FedAvg (AirFedAvg) algorithms under both strongly convex and non-convex settings with constant and diminishing learning rates in the presence of data heterogeneity. Through convergence and asymptotic analysis, we characterize the impact of aggregation error on the convergence bound and provide insights for system design with convergence guarantees. Then we derive convergence rates for AirFedAvg algorithms for strongly convex and non-convex objectives. For different types of local updates that can be transmitted by edge devices (i.e., local model, gradient, and model difference), we reveal that transmitting local model in AirFedAvg may cause divergence in the training procedure. In addition, we consider more practical signal processing schemes to improve the communication efficiency and further extend the convergence analysis to different forms of model aggregation error caused by these signal processing schemes. Extensive simulation results under different settings of objective functions, transmitted local information, and communication schemes verify the theoretical conclusions.


title: Orthogonal Uncertainty Representation of Data Manifold for Robust Long-Tailed Learning

abstract: In scenarios with long-tailed distributions, the model's ability to identify tail classes is limited due to the under-representation of tail samples. Class rebalancing, information augmentation, and other techniques have been proposed to facilitate models to learn the potential distribution of tail classes. The disadvantage is that these methods generally pursue models with balanced class accuracy on the data manifold, while ignoring the ability of the model to resist interference. By constructing noisy data manifold, we found that the robustness of models trained on unbalanced data has a long-tail phenomenon. That is, even if the class accuracy is balanced on the data domain, it still has bias on the noisy data manifold. However, existing methods cannot effectively mitigate the above phenomenon, which makes the model vulnerable in long-tailed scenarios. In this work, we propose an Orthogonal Uncertainty Representation (OUR) of feature embedding and an end-to-end training strategy to improve the long-tail phenomenon of model robustness. As a general enhancement tool, OUR has excellent compatibility with other methods and does not require additional data generation, ensuring fast and efficient training. Comprehensive evaluations on long-tailed datasets show that our method significantly improves the long-tail phenomenon of robustness, bringing consistent performance gains to other long-tailed learning methods.


title: Modular flavor models with positive modular weights: a new lepton model building

abstract: We propose an interesting assignment of positive modular wights for fields in a modular non-Abelian discrete flavor symmetry. By this assignment, we can construct inverse seesaw and linear seesaw models without any additional symmetries which possess good testability in current experiments. At first, we discuss probabilities for positive modular wights from a theoretical point of view. Then we show concrete examples of inverse seesaw and linear seesaw scenarios applying modular $A_4$ symmetry as examples and demonstrate some predictions as well as being consistent with experimental results such as their masses and mixings.


title: Label Differential Privacy via Aggregation

abstract: In many real-world applications, due to recent developments in the privacy landscape, training data may be aggregated to preserve the privacy of sensitive training labels. In the learning from label proportions (LLP) framework, the dataset is partitioned into bags of feature-vectors which are available only with the sum of the labels per bag. A further restriction, which we call learning from bag aggregates (LBA) is where instead of individual feature-vectors, only the (possibly weighted) sum of the feature-vectors per bag is available. We study whether such aggregation techniques can provide privacy guarantees under the notion of label differential privacy (label-DP) previously studied in for e.g. [Chaudhuri-Hsu'11, Ghazi et al.'21, Esfandiari et al.'22]. It is easily seen that naive LBA and LLP do not provide label-DP. Our main result however, shows that weighted LBA using iid Gaussian weights with $m$ randomly sampled disjoint $k$-sized bags is in fact $(\varepsilon, \delta)$-label-DP for any $\varepsilon > 0$ with $\delta \approx \exp(-\Omega(\sqrt{k}))$ assuming a lower bound on the linear-mse regression loss. Further, the $\ell_2^2$-regressor which minimizes the loss on the aggregated dataset has a loss within $\left(1 + o(1)\right)$-factor of the optimum on the original dataset w.p. $\approx 1 - exp(-\Omega(m))$. We emphasize that no additive label noise is required. The analogous weighted-LLP does not however admit label-DP. Nevertheless, we show that if additive $N(0, 1)$ noise can be added to any constant fraction of the instance labels, then the noisy weighted-LLP admits similar label-DP guarantees without assumptions on the dataset, while preserving the utility of Lipschitz-bounded neural mse-regression tasks. Our work is the first to demonstrate that label-DP can be achieved by randomly weighted aggregation for regression tasks, using no or little additive noise.


title: High-speed full-color computer-generated holography using a digital micromirror device and fiber-coupled RGB laser diode

abstract: Computer-generated holography (CGH) can be used to display three-dimensional (3D) images and has a special feature that no other technology possesses: it can reconstruct arbitrary object wavefronts. In this study, we investigated a high-speed full-color reconstruction method for improving the realism of 3D images produced using CGH. The proposed method uses a digital micromirror device (DMD) with a high-speed switching capability as the hologram display device. It produces 3D video by time-division multiplexing using an optical system incorporating fiber-coupled laser diodes (LDs) operating in red, green, and blue wavelengths. The wavelength dispersion of the DMD is compensated for by superimposing plane waves on the hologram. Fourier transform optics are used to separate the object, conjugate, and zeroth-order light, thus eliminating the need for an extensive 4f system. The resources used in this research, such as the programs used for the hologram generation and the schematics of the LD driver, are available on GitHub.


title: Decomposed Prompt Tuning via Low-Rank Reparameterization

abstract: While prompt tuning approaches have achieved competitive performance with high efficiency, we observe that they invariably employ the same initialization process, wherein the soft prompt is either randomly initialized or derived from an existing embedding vocabulary. In contrast to these conventional methods, this study aims to investigate an alternative way to derive soft prompt. Our empirical studies show that the soft prompt typically exhibits a low intrinsic rank characteristic. With such observations, we propose decomposed prompt tuning, a novel approach that utilizes low-rank matrices to initialize the soft prompt. Through the low-rank reparameterization, our method significantly reduces the number of trainable parameters while maintaining effectiveness. Experimental results on the SuperGLUE benchmark in both high-resource and low-resource scenarios demonstrate the effectiveness of the proposed method.


title: A Multi-Scale Spatial Transformer U-Net for Simultaneously Automatic Reorientation and Segmentation of 3D Nuclear Cardiac Images

abstract: Accurate reorientation and segmentation of the left ventricular (LV) is essential for the quantitative analysis of myocardial perfusion imaging (MPI), in which one critical step is to reorient the reconstructed transaxial nuclear cardiac images into standard short-axis slices for subsequent image processing. Small-scale LV myocardium (LV-MY) region detection and the diverse cardiac structures of individual patients pose challenges to LV segmentation operation. To mitigate these issues, we propose an end-to-end model, named as multi-scale spatial transformer UNet (MS-ST-UNet), that involves the multi-scale spatial transformer network (MSSTN) and multi-scale UNet (MSUNet) modules to perform simultaneous reorientation and segmentation of LV region from nuclear cardiac images. The proposed method is trained and tested using two different nuclear cardiac image modalities: 13N-ammonia PET and 99mTc-sestamibi SPECT. We use a multi-scale strategy to generate and extract image features with different scales. Our experimental results demonstrate that the proposed method significantly improves the reorientation and segmentation performance. This joint learning framework promotes mutual enhancement between reorientation and segmentation tasks, leading to cutting edge performance and an efficient image processing workflow. The proposed end-to-end deep network has the potential to reduce the burden of manual delineation for cardiac images, thereby providing multimodal quantitative analysis assistance for physicists.


title: LLP-Bench: A Large Scale Tabular Benchmark for Learning from Label Proportions

abstract: In the task of Learning from Label Proportions (LLP), a model is trained on groups (a.k.a bags) of instances and their corresponding label proportions to predict labels for individual instances. LLP has been applied pre-dominantly on two types of datasets - image and tabular. In image LLP, bags of fixed size are created by randomly sampling instances from an underlying dataset. Bags created via this methodology are called random bags. Experimentation on Image LLP has been mostly on random bags on CIFAR-* and MNIST datasets. Despite being a very crucial task in privacy sensitive applications, tabular LLP does not yet have a open, large scale LLP benchmark. One of the unique properties of tabular LLP is the ability to create feature bags where all the instances in a bag have the same value for a given feature. It has been shown in prior research that feature bags are very common in practical, real world applications [Chen et. al '23, Saket et. al. '22]. In this paper, we address the lack of a open, large scale tabular benchmark. First we propose LLP-Bench, a suite of 70 LLP datasets (62 feature bag and 8 random bag datasets) created from the Criteo CTR prediction and the Criteo Sponsored Search Conversion Logs datasets, the former a classification and the latter a regression dataset. These LLP datasets represent diverse ways in which bags can be constructed from underlying tabular data. To the best of our knowledge, LLP-Bench is the first large scale tabular LLP benchmark with an extensive diversity in constituent datasets. Second, we propose four metrics that characterize and quantify the hardness of a LLP dataset. Using these four metrics we present deep analysis of the 62 feature bag datasets in LLP-Bench. Finally we present the performance of 9 SOTA and popular tabular LLP techniques on all the 62 datasets.


title: Precise tail behavior of some Dirichlet series

abstract: Let $\eta_1$, $\eta_2,\ldots$ be independent copies of a random variable $\eta$ with zero mean and finite variance which is bounded from the right, that is, $\eta\leq b$ almost surely for some $b>0$. Considering different types of the asymptotic behaviour of the probability $\mathbb{P}\{\eta\in[b-x,b]\}$ as $x\to 0+$ we derive precise tail asymptotics of the random Dirichlet series $\sum_{k\geq 1}k^{-\alpha}\eta_k$ for $\alpha\in (1/2, 1]$.


title: PAC Learning Linear Thresholds from Label Proportions

abstract: Learning from label proportions (LLP) is a generalization of supervised learning in which the training data is available as sets or bags of feature-vectors (instances) along with the average instance-label of each bag. The goal is to train a good instance classifier. While most previous works on LLP have focused on training models on such training data, computational learnability of LLP was only recently explored by [Saket'21, Saket'22] who showed worst case intractability of properly learning linear threshold functions (LTFs) from label proportions. However, their work did not rule out efficient algorithms for this problem on natural distributions. In this work we show that it is indeed possible to efficiently learn LTFs using LTFs when given access to random bags of some label proportion in which feature-vectors are, conditioned on their labels, independently sampled from a Gaussian distribution $N(\mathbf{\mu}, \mathbf{\Sigma})$. Our work shows that a certain matrix -- formed using covariances of the differences of feature-vectors sampled from the bags with and without replacement -- necessarily has its principal component, after a transformation, in the direction of the normal vector of the LTF. Our algorithm estimates the means and covariance matrices using subgaussian concentration bounds which we show can be applied to efficiently sample bags for approximating the normal direction. Using this in conjunction with novel generalization error bounds in the bag setting, we show that a low error hypothesis LTF can be identified. For some special cases of the $N(\mathbf{0}, \mathbf{I})$ distribution we provide a simpler mean estimation based algorithm. We include an experimental evaluation of our learning algorithms along with a comparison with those of [Saket'21, Saket'22] and random LTFs, demonstrating the effectiveness of our techniques.


title: Theoretical demonstration of the possibility of using binary alloys or solid solutions in ternary systems as geothermometers

abstract: The investigation of the processes of mineral deposit formation and their history is a fundamental task. Solving this task can increase mining efficiency and make a significant contribution to understanding the formation of the Earth's crust. The main approach to solving this task is determining the values of thermodynamic functions for phases present in deposits. One of the most promising and flexible methods for studying thermodynamic properties is the EMF method. This article describes the basic principles of the EMF method and provides all possible interpretations of the obtained results. It has also been demonstrated that direct EMF measurements can determine the composition of a solid solution or alloy in a multicomponent system if its EMF dependencies are known. Based on this fact, it can be concluded that any alloy or solid solution in a multi-phase association, which undergoes composition changes with temperature and can be quenched, can be used as a geothermometer or geobarometer.


title: An Ultrahigh-energy $\gamma$-ray Bubble Powered by a Super PeVatron

abstract: We report the detection of a $\gamma$-ray bubble spanning at least 100$\rm deg^2$ in ultra high energy (UHE) up to a few PeV in the direction of the star-forming region Cygnus X, implying the presence Super PeVatron(s) accelerating protons to at least 10 PeV. A log-parabola form with the photon index $\Gamma (E) = (2.71 \pm 0.02) + (0.11 \pm 0.02) \times \log_{10} (E/10 \ {\rm TeV})$ is found fitting the gamma-ray energy spectrum of the bubble well. UHE sources, `hot spots' correlated with very massive molecular clouds, and a quasi-spherical amorphous $\gamma$-ray emitter with a sharp central brightening are observed in the bubble. In the core of $\sim 0.5^{\circ}$, spatially associating with a region containing massive OB association (Cygnus OB2) and a microquasar (Cygnus X-3), as well as previously reported multi-TeV sources, an enhanced concentration of UHE $\gamma$-rays are observed with 2 photons at energies above 1 PeV. The general feature of the bubble, the morphology and the energy spectrum, are reasonably reproduced by the assumption of a particle accelerator in the core, continuously injecting protons into the ambient medium.


title: Random-order Contention Resolution via Continuous Induction: Tightness for Bipartite Matching under Vertex Arrivals

abstract: We introduce a new approach for designing Random-order Contention Resolution Schemes (RCRS) via exact solution in continuous time. Given a function $c(y):[0,1] \rightarrow [0,1]$, we show how to select each element which arrives at time $y \in [0,1]$ with probability exactly $c(y)$. We provide a rigorous algorithmic framework for achieving this, which discretizes the time interval and also needs to sample its past execution to ensure these exact selection probabilities. We showcase our framework in the context of online contention resolution schemes for matching with random-order vertex arrivals. For bipartite graphs with two-sided arrivals, we design a $(1+e^{-2})/2 \approx 0.567$-selectable RCRS, which we also show to be tight. Next, we show that the presence of short odd-length cycles is the only barrier to attaining a (tight) $(1+e^{-2})/2$-selectable RCRS on general graphs. By generalizing our bipartite RCRS, we design an RCRS for graphs with odd-length girth $g$ which is $(1+e^{-2})/2$-selectable as $g \rightarrow \infty$. This convergence happens very rapidly: for triangle-free graphs (i.e., $g \ge 5$), we attain a $121/240 + 7/16 e^2 \approx 0.563$-selectable RCRS. Finally, for general graphs we improve on the $8/15 \approx 0.533$-selectable RCRS of Fu et al. (ICALP, 2021) and design an RCRS which is at least $0.535$-selectable. Due to the reduction of Ezra et al. (EC, 2020), our bounds yield a $0.535$-competitive (respectively, $(1+e^{-2})/2$-competitive) algorithm for prophet secretary matching on general (respectively, bipartite) graphs under vertex arrivals.


title: KAKURENBO: Adaptively Hiding Samples in Deep Neural Network Training

abstract: This paper proposes a method for hiding the least-important samples during the training of deep neural networks to increase efficiency, i.e., to reduce the cost of training. Using information about the loss and prediction confidence during training, we adaptively find samples to exclude in a given epoch based on their contribution to the overall learning process, without significantly degrading accuracy. We explore the converge properties when accounting for the reduction in the number of SGD updates. Empirical results on various large-scale datasets and models used directly in image classification and segmentation show that while the with-replacement importance sampling algorithm performs poorly on large datasets, our method can reduce total training time by up to 22% impacting accuracy only by 0.4% compared to the baseline. Code available at https://github.com/TruongThaoNguyen/kakurenbo


title: Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planning

abstract: Navigation in unfamiliar environments presents a major challenge for robots: while mapping and planning techniques can be used to build up a representation of the world, quickly discovering a path to a desired goal in unfamiliar settings with such methods often requires lengthy mapping and exploration. Humans can rapidly navigate new environments, particularly indoor environments that are laid out logically, by leveraging semantics -- e.g., a kitchen often adjoins a living room, an exit sign indicates the way out, and so forth. Language models can provide robots with such knowledge, but directly using language models to instruct a robot how to reach some destination can also be impractical: while language models might produce a narrative about how to reach some goal, because they are not grounded in real-world observations, this narrative might be arbitrarily wrong. Therefore, in this paper we study how the ``semantic guesswork'' produced by language models can be utilized as a guiding heuristic for planning algorithms. Our method, Language Frontier Guide (LFG), uses the language model to bias exploration of novel real-world environments by incorporating the semantic knowledge stored in language models as a search heuristic for planning with either topological or metric maps. We evaluate LFG in challenging real-world environments and simulated benchmarks, outperforming uninformed exploration and other ways of using language models.


title: Cosmological Solutions of Chameleon Scalar Field Model

abstract: We investigate cosmological solutions of the chameleon model with a non-minimal coupling between the matter and the scalar field through a conformal factor with gravitational strength. By considering the spatially flat FLRW metric and the matter density as a non-relativistic perfect fluid, we focus on the matter-dominated phase and the late-time accelerated phase of the universe. In this regard, we manipulate and scrutinize the related field equations for the density parameters of the matter and the scalar fields with respect to the e-folding. Since the scalar field fluctuations depend on the background and the field equations become highly non-linear, we probe and derive the governing equations in the context of various cases of the relation between the kinetic and potential energies of the chameleon scalar field, or indeed, for some specific cases of the scalar field equation of state parameter. Thereupon, we schematically plot those density parameters for two different values of the chameleon non-minimal coupling parameter, and discuss the results. In both considered phases, we specify that, when the kinetic energy of the chameleon scalar field is much less than its potential energy (i.e., when the scalar field equation of state parameter is $\simeq - 1 $), the behavior of the chameleon model is similar to the $\Lambda CDM$ model. Such compatibility suggests that the chameleon model is phenomenologically viable and can be tested with the observational data.


title: Stochastic 1d Burgers equation as a model for hydrodynamical turbulence

abstract: This work is a review with proofs of a group of results on the stochastic Burgers equation with small viscosity, obtained during the last two decades. These results jointly show that the equation makes a surprisingly good model of hydrodynamical turbulence. The model provides natural and rigorously justified analogies of a number of key predictions of the theory of turbulence, including the main assertions of the Kolmogorov approach to turbulence, known as the K41 theory.


title: End-to-end Multichannel Speaker-Attributed ASR: Speaker Guided Decoder and Input Feature Analysis

abstract: We present an end-to-end multichannel speaker-attributed automatic speech recognition (MC-SA-ASR) system that combines a Conformer-based encoder with multi-frame crosschannel attention and a speaker-attributed Transformer-based decoder. To the best of our knowledge, this is the first model that efficiently integrates ASR and speaker identification modules in a multichannel setting. On simulated mixtures of LibriSpeech data, our system reduces the word error rate (WER) by up to 12% and 16% relative compared to previously proposed single-channel and multichannel approaches, respectively. Furthermore, we investigate the impact of different input features, including multichannel magnitude and phase information, on the ASR performance. Finally, our experiments on the AMI corpus confirm the effectiveness of our system for real-world multichannel meeting transcription.


title: Posterior Sampling-based Online Learning for Episodic POMDPs

abstract: Learning in POMDPs is known to be significantly harder than MDPs. In this paper, we consider the online learning problem for episodic POMDPs with unknown transition and observation models. We propose a Posterior Sampling-based reinforcement learning algorithm for POMDPs (PS4POMDPs), which is much simpler and more implementable compared to state-of-the-art optimism-based online learning algorithms for POMDPs. We show that the Bayesian regret of the proposed algorithm scales as the square root of the number of episodes, matching the lower bound, and is polynomial in the other parameters. In a general setting, its regret scales exponentially in the horizon length $H$, and we show that this is inevitable by providing a lower bound. However, when the POMDP is undercomplete and weakly revealing (a common assumption in the recent literature), we establish a polynomial Bayesian regret bound. We finally propose a posterior sampling algorithm for multi-agent POMDPs, and show it too has sublinear regret.


title: On Generative Agents in Recommendation

abstract: Recommender systems are the cornerstone of today's information dissemination, yet a disconnect between offline metrics and online performance greatly hinders their development. Addressing this challenge, we envision a recommendation simulator, capitalizing on recent breakthroughs in human-level intelligence exhibited by Large Language Models (LLMs). We propose Agent4Rec, a user simulator in recommendation, leveraging LLM-empowered generative agents equipped with user profile, memory, and actions modules specifically tailored for the recommender system. In particular, these agents' profile modules are initialized using real-world datasets (e.g. MovieLens, Steam, Amazon-Book), capturing users' unique tastes and social traits; memory modules log both factual and emotional memories and are integrated with an emotion-driven reflection mechanism; action modules support a wide variety of behaviors, spanning both taste-driven and emotion-driven actions. Each agent interacts with personalized recommender models in a page-by-page manner, relying on a pre-implemented collaborative filtering-based recommendation algorithm. We delve into both the capabilities and limitations of Agent4Rec, aiming to explore an essential research question: ``To what extent can LLM-empowered generative agents faithfully simulate the behavior of real, autonomous humans in recommender systems?'' Extensive and multi-faceted evaluations of Agent4Rec highlight both the alignment and deviation between agents and user-personalized preferences. Beyond mere performance comparison, we explore insightful experiments, such as emulating the filter bubble effect and discovering the underlying causal relationships in recommendation tasks. Our codes are available at https://github.com/LehengTHU/Agent4Rec.


title: Instability of conformally K\"ahler, Einstein metrics

abstract: We prove the instability of conformally K\"ahler, compact or ALF Einstein 4-manifolds with nonnegative scalar curvature which are not half conformally flat. This applies to all the known examples of gravitational instantons which are not hyperK\"ahler and to the Chen-Lebrun-Weber metric in particular.


title: Exploiting array manipulation habits to optimize garbage collection and type flow analysis

abstract: A widespread practice to implement a flexible array is to consider the storage area into two parts: the used area, which is already available for read/write operations, and the supply area, which is used in case of enlargement of the array. The main purpose of the supply area is to avoid as much as possible the reallocation of the whole storage area in case of enlargement. As the supply area is not used by the application, the main idea of the paper is to convey the information to the garbage collector, making it possible to avoid completely the marking of the supply area. We also present a simple method to analyze the types of objects, which are stored in an array as well as the possible presence of NULL values within the array. This allows us to better specialize the work of the garbage collector when marking the used area, and also, by transitivity, to improve overall results for type analysis of all expressions of the source code. After introducing several abstract data types, which represent the main arrays concerned by our technique (i.e., zero or variable indexing, circular arrays and hash maps), we measure its impact during the bootstrap of two compilers whose libraries are equipped with these abstract data types. We then measure, on various software products we have not written, the frequency of certain habits of manipulation of arrays, to assess the validity of our approach.


title: Exceptional point sensing via energy loss profile in a non-Hermitian system

abstract: The heightened sensitivity observed in non-Hermitian systems at exceptional points (EPs) has garnered significant attention. Typical EP sensor implementations rely on precise measurements of spectra and importantly, for real time sensing measurements, the EP condition ceases to hold as the perturbation increases over time, thereby preventing the use of high sensitivity at the EP point. In this work, we present an new approach to EP sensing which goes beyond these two traditional constraints. Firstly, instead of measuring the spectra, our scheme of EP based sensing is based on the observation of decay length of the optical mode in finite size gratings, which is validated via coupled mode theory as well as full wave electrodynamic simulations. Secondly, for larger perturbation strengths, the EP is spectrally shifted instead of being destroyed -- this spectral shift of the EP is calibrated and using this look-up table, we propose continuous real time detection by varying the excitation laser wavelength. As a proof of principle of our technique, we present an application to the sensing of coronavirus particles, which shows unprecedented limit of detection. These findings will contribute to the expanding field of exceptional point based sensing technologies for real time applications beyond spectral measurements.


title: Genus theory of p-adic pseudo-measures -- Tame kernels and abelian p-ramification

abstract: We consider, for real abelian fields K, the Birch--Tate formula linking the tame kernel \#K\_2(Z\_K) to $\zeta$\_K(-1); we compare, for quadratic and cyclic cubic fields with p=2,3, \#K\_2(\BZ\_K)[p^$\infty$] to the order of the torsion group T\_{K, p} of abelian p-ramification theory given by the residue of $\zeta$\_{K, p}(s) at s=1. This is done via the ``genus theory'' of p-adic pseudo-measures, inaugurated in the 1970/80's and the fact that T\_{K, p} only depends on the p-class group and on the normalized p-adic regulator of K (Theorem A). We apply this to prove a conjecture of Deng--Li giving the structures of K\_2(Z\_K)[2^$\infty$] for an interesting family of real quadratic fields (Theorem B). Then, for p>3, we give a lower bound of the p-rank of K\_2(\BZ\_K) in cyclic p-extensions (Theorem C). Complements, PARI programs and tables are given in an Appendix.


title: Recognisability of the sporadic groups by the isomorphism types of their prime graphs

abstract: The prime graph of a finite group $G$ is the labelled graph $\Gamma(G)$ with vertices the prime divisors of $|G|$ and edges the pairs $\{p,q\}$ for which $G$ contains an element of order $pq$. A group $G$ is recognisable by its prime graph if every group $H$ with $\Gamma(H)=\Gamma(G)$ is isomorphic to $G$. Cameron and Maslova have shown that every group that is recognisable by its prime graph is almost simple, which justifies the significant amount of attention that has been given to determining which simple (or almost simple) groups are recognisable by their prime graphs. This problem has been completely solved for certain families of simple groups, including the sporadic groups. A natural extension of the problem is to determine which groups are recognisable by their unlabelled prime graphs, i.e. by the isomorphism types of their prime graphs. There seem to be only very limited results in this direction in the literature. Here we determine which of the sporadic finite simple groups are recognisable by the isomorphism types of their prime graphs. We also show that for every sporadic group $G$ that is not recognisable by the isomorphism type of $\Gamma(G)$, there are infinitely many groups $H$ with $\Gamma(H) \cong \Gamma(G)$.


title: Node classification in networks via simplicial interactions

abstract: In the node classification task, it is intuitively understood that densely connected nodes tend to exhibit similar attributes. However, it is crucial to first define what constitutes a dense connection and to develop a reliable mathematical tool for assessing node cohesiveness. In this paper, we propose a probability-based objective function for semi-supervised node classification that takes advantage of higher-order networks' capabilities. The proposed function embodies the philosophy most aligned with the intuition behind classifying within higher-order networks, as it is designed to reduce the likelihood of nodes interconnected through higher-order networks bearing different labels. We evaluate the function using both balanced and imbalanced datasets generated by the Planted Partition Model (PPM), as well as a real-world political book dataset. According to the results, in challenging classification contexts characterized by low homo-connection probability, high hetero-connection probability, and limited prior information of nodes, higher-order networks outperform pairwise interactions in terms of objective function performance. Notably, the objective function exhibits elevated Recall and F1-score relative to Precision in the imbalanced dataset, indicating its potential applicability in many domains where detecting false negatives is critical, even at the expense of some false positives.


title: A non-asymptotic analysis of the single component PLS regression

abstract: This paper investigates some theoretical properties of the Partial Least Square (PLS) method. We focus our attention on the single component case, that provides a useful framework to understand the underlying mechanism. We provide a non-asymptotic upper bound on the quadratic loss in prediction with high probability in a high dimensional regression context. The bound is attained thanks to a preliminary test on the first PLS component. In a second time, we extend these results to the sparse partial least squares (sPLS) approach. In particular, we exhibit upper bounds similar to those obtained with the lasso algorithm, up to an additional restricted eigenvalue constraint on the design matrix.


title: Digital Microfluidics? How Magnetically Driven Orientation of Pillars Influences Droplet Positioning

abstract: Interfaces between a water droplet and a network of pillars produce eventually superhydrophobic, self-cleaning properties. Considering the surface fraction of the surface in interaction with water, it is possible to tune precisely the contact angle hysteresis (CAH) to low values, which is at the origin of the poor adhesion of water droplets, inducing their high mobility on such a surface. However, if one wants to move and position a droplet, the lower the CAH, the less precise will be the positioning on the surface. While rigid surfaces limit the possibilities of actuation, smart surfaces have been devised with which a stimulus can be used to trigger the displacement of a droplet. Light, electron beam, mechanical stimulation like vibration, or magnetism can be used to induce a displacement of droplets on surfaces and transfer them from one position to the targeted one. Among these methods, only few are reversible, leading to anisotropy-controlled orientation of the structured interface with water. Magnetically driven superhydrophobic surfaces are the most promising reprogramming surfaces that can lead to the control of wettability and droplet guidance.


title: Federated Learning with Convex Global and Local Constraints

abstract: In practice, many machine learning (ML) problems come with constraints, and their applied domains involve distributed sensitive data that cannot be shared with others, e.g., in healthcare. Collaborative learning in such practical scenarios entails federated learning (FL) for ML problems with constraints, or FL with constraints for short. Despite the extensive developments of FL techniques in recent years, these techniques only deal with unconstrained FL problems or FL problems with simple constraints that are amenable to easy projections. There is little work dealing with FL problems with general constraints. To fill this gap, we take the first step toward building an algorithmic framework for solving FL problems with general constraints. In particular, we propose a new FL algorithm for constrained ML problems based on the proximal augmented Lagrangian (AL) method. Assuming convex objective and convex constraints plus other mild conditions, we establish the worst-case complexity of the proposed algorithm. Our numerical experiments show the effectiveness of our algorithm in performing Neyman-Pearson classification and fairness-aware learning with nonconvex constraints, in an FL setting.


title: Learning to Rank Context for Named Entity Recognition Using a Synthetic Dataset

abstract: While recent pre-trained transformer-based models can perform named entity recognition (NER) with great accuracy, their limited range remains an issue when applied to long documents such as whole novels. To alleviate this issue, a solution is to retrieve relevant context at the document level. Unfortunately, the lack of supervision for such a task means one has to settle for unsupervised approaches. Instead, we propose to generate a synthetic context retrieval training dataset using Alpaca, an instructiontuned large language model (LLM). Using this dataset, we train a neural context retriever based on a BERT model that is able to find relevant context for NER. We show that our method outperforms several retrieval baselines for the NER task on an English literary dataset composed of the first chapter of 40 books.


title: The Uniform Distribution Modulo One of Certain Subsequences of Ordinates of Zeros of the Zeta Function

abstract: On the assumption of the Riemann hypothesis and a spacing hypothesis for the nontrivial zeros $\frac12+i\gamma$ of the Riemann zeta function, we show that the sequence \[ \Gamma_{[a, b]} =\Bigg\{ \gamma : \gamma>0 \quad \mbox{and} \quad \frac{ \log\big(| \zeta^{(m_{\gamma})} (\frac12+ i\gamma) | / (\log{\gamma})^{m_{\gamma}}\big)}{\sqrt{\frac12\log\log{\gamma}}} \in [a, b] \Bigg\}, \] where the $\gamma$ are arranged in increasing order, is uniformly distributed modulo one. Here $a$ and $b$ are real numbers with $a<b$, and $m_{\gamma}$ denotes the multiplicity of the zero $\frac12+i\gamma$. The same result holds when the $\gamma$'s are restricted to be the ordinates of simple zeros. With an extra hypothesis, we are also able to show an equidistribution result for the scaled numbers $\gamma (\log T)/2\pi$ with $\gamma\in \Gamma_{[a, b]}$ and $0<\gamma\leq T$.


title: Discrepancy and approximation of absolutely continuous measures with atomic measures

abstract: We prove several results concerning the discrepancy, tested on balls in the $d$-dimensional torus $\mathbb{T}^{d}$, between absolutely continuous measures and finite atomic measures.


title: From Continuous Dynamics to Graph Neural Networks: Neural Diffusion and Beyond

abstract: Graph neural networks (GNNs) have demonstrated significant promise in modelling relational data and have been widely applied in various fields of interest. The key mechanism behind GNNs is the so-called message passing where information is being iteratively aggregated to central nodes from their neighbourhood. Such a scheme has been found to be intrinsically linked to a physical process known as heat diffusion, where the propagation of GNNs naturally corresponds to the evolution of heat density. Analogizing the process of message passing to the heat dynamics allows to fundamentally understand the power and pitfalls of GNNs and consequently informs better model design. Recently, there emerges a plethora of works that proposes GNNs inspired from the continuous dynamics formulation, in an attempt to mitigate the known limitations of GNNs, such as oversmoothing and oversquashing. In this survey, we provide the first systematic and comprehensive review of studies that leverage the continuous perspective of GNNs. To this end, we introduce foundational ingredients for adapting continuous dynamics to GNNs, along with a general framework for the design of graph neural dynamics. We then review and categorize existing works based on their driven mechanisms and underlying dynamics. We also summarize how the limitations of classic GNNs can be addressed under the continuous framework. We conclude by identifying multiple open research directions.


title: Klein-Gordon particles in a quasi-pointlike global monopole spacetime and a Wu-Yang magnetic monopole: invariance and isospectrality

abstract: We use two correlated metric functions and transform/deform the pointlike global monopole (PGM) spacetime metric into a quasi-PGM (QPGM) spacetime one. We study Klein-Gordon (KG) particles (manifestly introduced by the non-minimal coupling form of the operator $% \tilde{D}_{\mu }=D_{\mu }+\mathcal{F}_{\mu }$, with $\mathcal{F}_{\mu }$ $% \in %TCIMACRO{\U{211d} }% %BeginExpansion \mathbb{R} %EndExpansion $, and $D_{\mu }=\partial _{\mu }-ieA_{\mu }$) in such QPGM spacetime background. We show that the KG-particles in the QPGM spacetime are isospectral and invariant with KG-particles in the PGM spacetime, provided that the two metric functions are correlated. The Wu-Yang magnetic monopole (WYMM) is also included in the process. We report the effects of both monopoles PGM/QPGM and WYMM on the spectroscopic structure of two models, KG-oscillators and KG-Coulomb particles in such spacetime background. Moreover, we discuss KG-Coulomb particles and shifted KG-oscillators in a PGM spacetime and a WYMM, where such models are manifestly introduced by some Lorentz scalar interaction potentials $S(r)$. The current study is not only of fundamental observability nature but also of pedagogical interest in quantum gravity.


title: AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion

abstract: We present AutoDIR, an innovative all-in-one image restoration system incorporating latent diffusion. AutoDIR excels in its ability to automatically identify and restore images suffering from a range of unknown degradations. AutoDIR offers intuitive open-vocabulary image editing, empowering users to customize and enhance images according to their preferences. Specifically, AutoDIR consists of two key stages: a Blind Image Quality Assessment (BIQA) stage based on a semantic-agnostic vision-language model which automatically detects unknown image degradations for input images, an All-in-One Image Restoration (AIR) stage utilizes structural-corrected latent diffusion which handles multiple types of image degradations. Extensive experimental evaluation demonstrates that AutoDIR outperforms state-of-the-art approaches for a wider range of image restoration tasks. The design of AutoDIR also enables flexible user control (via text prompt) and generalization to new tasks as a foundation model of image restoration. Project is available at: \url{https://jiangyitong.github.io/AutoDIR_webpage/}.


title: A Comprehensive Study of Privacy Risks in Curriculum Learning

abstract: Training a machine learning model with data following a meaningful order, i.e., from easy to hard, has been proven to be effective in accelerating the training process and achieving better model performance. The key enabling technique is curriculum learning (CL), which has seen great success and has been deployed in areas like image and text classification. Yet, how CL affects the privacy of machine learning is unclear. Given that CL changes the way a model memorizes the training data, its influence on data privacy needs to be thoroughly evaluated. To fill this knowledge gap, we perform the first study and leverage membership inference attack (MIA) and attribute inference attack (AIA) as two vectors to quantify the privacy leakage caused by CL. Our evaluation of nine real-world datasets with attack methods (NN-based, metric-based, label-only MIA, and NN-based AIA) revealed new insights about CL. First, MIA becomes slightly more effective when CL is applied, but the impact is much more prominent to a subset of training samples ranked as difficult. Second, a model trained under CL is less vulnerable under AIA, compared to MIA. Third, the existing defense techniques like DP-SGD, MemGuard, and MixupMMD are still effective under CL, though DP-SGD has a significant impact on target model accuracy. Finally, based on our insights into CL, we propose a new MIA, termed Diff-Cali, which exploits the difficulty scores for result calibration and is demonstrated to be effective against all CL methods and the normal training method. With this study, we hope to draw the community's attention to the unintended privacy risks of emerging machine-learning techniques and develop new attack benchmarks and defense solutions.


title: Few-shot Action Recognition with Captioning Foundation Models

abstract: Transferring vision-language knowledge from pretrained multimodal foundation models to various downstream tasks is a promising direction. However, most current few-shot action recognition methods are still limited to a single visual modality input due to the high cost of annotating additional textual descriptions. In this paper, we develop an effective plug-and-play framework called CapFSAR to exploit the knowledge of multimodal models without manually annotating text. To be specific, we first utilize a captioning foundation model (i.e., BLIP) to extract visual features and automatically generate associated captions for input videos. Then, we apply a text encoder to the synthetic captions to obtain representative text embeddings. Finally, a visual-text aggregation module based on Transformer is further designed to incorporate cross-modal spatio-temporal complementary information for reliable few-shot matching. In this way, CapFSAR can benefit from powerful multimodal knowledge of pretrained foundation models, yielding more comprehensive classification in the low-shot regime. Extensive experiments on multiple standard few-shot benchmarks demonstrate that the proposed CapFSAR performs favorably against existing methods and achieves state-of-the-art performance. The code will be made publicly available.


title: A Non-monotonic Smooth Activation Function

abstract: Activation functions are crucial in deep learning models since they introduce non-linearity into the networks, allowing them to learn from errors and make adjustments, which is essential for learning complex patterns. The essential purpose of activation functions is to transform unprocessed input signals into significant output activations, promoting information transmission throughout the neural network. In this study, we propose a new activation function called Sqish, which is a non-monotonic and smooth function and an alternative to existing ones. We showed its superiority in classification, object detection, segmentation tasks, and adversarial robustness experiments. We got an 8.21% improvement over ReLU on the CIFAR100 dataset with the ShuffleNet V2 model in the FGSM adversarial attack. We also got a 5.87% improvement over ReLU on image classification on the CIFAR100 dataset with the ShuffleNet V2 model.


title: Quantification of the electric dipole moment generated by hadronic CP violation: resolution of the strong CP problem

abstract: The atomic, nuclear, and nucleon electric dipole moments (EDMs) have significant sensitivity to the CP violation of elementary particle physics, but its quantification has for long been obstructed by the nonperturbative physics of quantum chromodynamics. Quite recently, there were significant progresses in this field, notably the quantification of hadron level CP violation and the resolution of the strong CP problem. In this proceedings contribution, we summarize this attempt by focussing on the latter topic, the resulting new paradigm of baryogenesis, and the modifications that have to be applied in the evaluation of the EDMs.


title: A modular table-top setup for ultrafast X-ray diffraction

abstract: We present a table-top setup for femtosecond time-resolved X-ray diffraction based on a Cu K{\alpha} (8.05 keV) laser driven plasma X-ray source. Due to its modular design it provides high accessibility to its individual components (e.g. X-ray optics and sample environment). The K{\alpha}-yield of the source is optimized using a pre-pulse scheme. A magnifying multilayer X-ray mirror with Montel-Helios geometry is used to collect the emitted radiation, resulting in a quasi-collimated flux of more than 105 Cu K{\alpha} photons/pulse impinging on the sample under investigation at a repetition rate of 10 Hz. A gas ionization chamber detector is placed right after the X-ray mirror and used for normalization of the diffraction signals enabling the measurement of relative signal changes of less than 1% even at the given low repetition rate. Time-resolved diffraction experiments on laser-excited epitaxial Bi films serve as an example to demonstrate the capabilities of the set-up. The set-up can also be used for Debye-Scherrer type measurements on poly-crystalline samples.


title: Minimal Timelike Surfaces in the Lorentz-Minkowski 3-space and Their Canonical Parameters

abstract: We study minimal timelike surfaces in $\mathbb R^3_1$ using a special Weierstrass-type formula in terms of holomorphic functions defined in the algebra of the double (split-complex) numbers. We present a method of obtaining an equation of a minimal timelike surface in terms of canonical parameters, which play a role similar to the role of the natural parameters of curves in $\mathbb R^3$. Having one holomorphic function that generates a minimal timelike surface, we find all holomorphic functions that generate the same surface. In this way we give a correspondence between a minimal timelike surface and a class of holomorphic functions. As an application, we prove that the Enneper surfaces are the only minimal timelike surfaces in $\mathbb R^3_1$ with polynomial parametrization of degree 3 in isothermal parameters.


title: Ferroelastic twin wall mediated ferro-flexoelectricity and bulk photovoltaic effect in SrTiO$_3$

abstract: Ferroelastic twin walls in nonpolar materials can give rise to a spontaneous polarization due to symmetry breaking. Nevertheless, the bi-stable polarity of twin walls and its reversal have not yet been demonstrated. Here, we report that the polarity of SrTiO$_3$ twin walls can be switched by ultra-low strain gradient. Using first-principles-based machine-learning potential, we demonstrate that the twin walls can be deterministically rotated and realigned in specific directions under strain gradient, which breaks the inversion symmetry of a sequence of walls and leads to a macroscopic polarization. The system can maintain polarity even after the strain gradient is removed. As a result, the polarization of twin walls can exhibit ferroelectric-like hysteresis loop upon cyclic bending, namely ferro-flexoelectricity. Finally, we propose a scheme to experimentally detect the polarity of twin wall by measuring the bulk photovoltaic responses. Our findings suggest a twin-wall-mediated ferro-flexoelectricity in SrTiO$_3$, which could be potentially exploited as functional elements in nano-electronic devices design.


title: 3DYoga90: A Hierarchical Video Dataset for Yoga Pose Understanding

abstract: The increasing popularity of exercises including yoga and Pilates has created a greater demand for professional exercise video datasets in the realm of artificial intelligence. In this study, we developed 3DYoga901, which is organized within a three-level label hierarchy. We have expanded the number of poses from an existing state-of-the-art dataset, increasing it from 82 to 90 poses. Our dataset includes meticulously curated RGB yoga pose videos and 3D skeleton sequences. This dataset was created by a dedicated team of six individuals, including yoga instructors. It stands out as one of the most comprehensive open datasets, featuring the largest collection of RGB videos and 3D skeleton sequences among publicly available resources. This contribution has the potential to significantly advance the field of yoga action recognition and pose assessment. Additionally, we conducted experiments to evaluate the practicality of our proposed dataset. We employed three different model variants for benchmarking purposes.


title: Non-defective degeneracy in non-Hermitian bipartite system

abstract: Starting from a Hermitian operator with two distinct eigenvalues, we construct a non-Hermitian bipartite system in Gaussian orthogonal ensemble according to random matrix theory, where we introduce the off-diagonal fluctuations through random eigenkets and realizing the bipartite configuration consisting of two $D\times D$ subsystems (with $D$ the Hilbert space dimension). As required by the global thermalization (chaos), one of the two subsystems is full ranked, while the other is rank deficient. For the latter subsystem, there is a block with non-defective degeneracies containing the non-linear symmetries, as well as the accumulation effect of the linear map in adjacent eigenvectors. The maximally mixed state made by the eigenvectors of this special region exhibit not thermal ensmeble behavior (neither canonical or Gibbs), and exhibit similar character with the corresponding reduced density, which can be verified through the Loschmitch echo and variance of the imaginary spectrum. This non-defective degeneracy region partly meets the Lemma in 10.1103/PhysRevLett.122.220603 and theorem in 10.1103/PhysRevLett.120.150603. The coexistence of strong entanglement and initial state fidelity in this region make it possible to achieve a maximally mixed density which, however, not be a thermal canonical ensemble (with complete insensitivity to the environmental energy or temperature). Outside this region, the collection of eigenstates (reduced density) always exhibit restriction on the corresponding Hilbert space dimension, and thus suppress the thermaliation. There are abundant physics for those densities in Hermitian and non-Hermitian bases, where we investigate seperately in this work.


title: Empowering SMPC: Bridging the Gap Between Scalability, Memory Efficiency and Privacy in Neural Network Inference

abstract: This paper aims to develop an efficient open-source Secure Multi-Party Computation (SMPC) repository, that addresses the issue of practical and scalable implementation of SMPC protocol on machines with moderate computational resources, while aiming to reduce the execution time. We implement the ABY2.0 protocol for SMPC, providing developers with effective tools for building applications on the ABY 2.0 protocol. This article addresses the limitations of the C++ based MOTION2NX framework for secure neural network inference, including memory constraints and operation compatibility issues. Our enhancements include optimizing the memory usage, reducing execution time using a third-party Helper node, and enhancing efficiency while still preserving data privacy. These optimizations enable MNIST dataset inference in just 32 seconds with only 0.2 GB of RAM for a 5-layer neural network. In contrast, the previous baseline implementation required 8.03 GB of RAM and 200 seconds of execution time.


title: CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalization

abstract: Language agents have shown some ability to interact with an external environment, e.g., a virtual world such as ScienceWorld, to perform complex tasks, e.g., growing a plant, without the startup costs of reinforcement learning. However, despite their zero-shot capabilities, these agents to date do not continually improve over time beyond performance refinement on a specific task. Here we present CLIN, the first language-based agent to achieve this, so that it continually improves over multiple trials, including when both the environment and task are varied, and without requiring parameter updates. Our approach is to use a persistent, dynamic, textual memory centered on causal abstractions (rather than general "helpful hints") that is regularly updated after each trial so that the agent gradually learns useful knowledge for new trials. In the ScienceWorld benchmark, CLIN is able to continually improve on repeated trials on the same task and environment, outperforming state-of-the-art reflective language agents like Reflexion by 23 absolute points. CLIN can also transfer its learning to new environments (or new tasks), improving its zero-shot performance by 4 points (13 for new tasks) and can further improve performance there through continual memory updates, enhancing performance by an additional 17 points (7 for new tasks). This suggests a new architecture for agents built on frozen models that can still continually and rapidly improve over time.


title: Choquet integrals, Hausdorff content and sparse operators

abstract: Let $H^d$, $0<d<n$, be the dyadic Hausdorff content of the $n$-dimensional Euclidean space ${\mathbb R}^n$. It is shown that $H^d$ counts a~Cantor set of the unit cube $[0, 1)^n$ as $\approx 1$, which implies unboundedness of the sparse operator ${\mathcal A}_{{\mathcal S}}$ on the Choquet space ${\mathcal L}^p(H^d)$, $p>0$. In this paper we verify that the sparse operator ${\mathcal A}_{{\mathcal S}}$ maps ${\mathcal L}^p(H^d)$, $1\le p<\infty$, into an associate space of Orlicz-Morrey space ${{\mathcal M}^{p'}_{\Phi_0}(H^d)}'$, $\Phi_0(t)=t\log(e+t)$. We also give another characterizations of those associate spaces using the tiling ${\mathcal T}$ of ${\mathbb R}^n$.


title: Mata, a Fast and Simple Finite Automata Library (Technical Report)

abstract: Mata is a well-engineered automata library written in C++ that offers a unique combination of speed and simplicity. It is meant to serve in applications such as string constraint solving and reasoning about regular expressions, and as a~reference implementation of automata algorithms. Besides basic algorithms for (non)deterministic automata, it implements a fast simulation reduction and antichain-based language inclusion checking. The simplicity allows a straightforward access to the low-level structures, making it relatively easy to extend and modify. Besides the C++ API, the library also implements a Python binding. The library comes with a large benchmark of automata problems collected from relevant applications such as string constraint solving, regular model checking, and reasoning about regular expressions. We show that Mata is on this benchmark significantly faster than all libraries from a wide range of automata libraries we collected. Its usefulness in string constraint solving is demonstrated by the string solver Z3-Noodler, which is based on Mata and outperforms the state of the art in string constraint solving on many standard benchmarks.