title: Residual neural networks to classify the high frequency emission in core-collapse supernova gravitational waves

abstract: We present the results of a detailed study on the detectability of the High Frequency Feature (HFF) in core-collapse supernova (CCSN) gravitational wave (GW) signals. We applied Residual Neural Networks (ResNet50), one of the state-of-the-art deep learning architectures in computer vision, to perform a multi-class classification of image samples built from time-frequency Morlet wavelet scalograms of LIGO-Virgo noise plus CCSN GW signals. We consider three target labels for three consecutive and mutually exclusive intervals in which the (first-order) slope of the HFF can be located. We optimized, trained, and tested the ResNet50 model with phenomenological waveforms. Next, we tested the optimized ResNet50 model with GW signals from CCSN simulations. At galactic distances of $1$Kpc and $5$Kpc with H1 and L1 data and $1$Kpc with V1 data, we obtained highly accurate results (test accuracies from $0.8933$ to $0.9867$), which show the feasibility of our methodology. In the case of further distances, we observed declines in test performance until $0.8000$ with H1 and L1 data at $10$Kpc and until $0.5933$ with V1 data at $10$Kpc. Without assuming the continuity and/or discontinuity of the HFF slope values, our methodology is general enough to address, at an early stage, the characterization of the HFF.


title: Multimodal Metadata Assignment for Cultural Heritage Artifacts

abstract: We develop a multimodal classifier for the cultural heritage domain using a late fusion approach and introduce a novel dataset. The three modalities are Image, Text, and Tabular data. We based the image classifier on a ResNet convolutional neural network architecture and the text classifier on a multilingual transformer architecture (XML-Roberta). Both are trained as multitask classifiers and use the focal loss to handle class imbalance. Tabular data and late fusion are handled by Gradient Tree Boosting. We also show how we leveraged specific data models and taxonomy in a Knowledge Graph to create the dataset and to store classification results. All individual classifiers accurately predict missing properties in the digitized silk artifacts, with the multimodal approach providing the best results.


title: A Batch Sequential Halving Algorithm without Performance Degradation

abstract: In this paper, we investigate the problem of pure exploration in the context of multi-armed bandits, with a specific focus on scenarios where arms are pulled in fixed-size batches. Batching has been shown to enhance computational efficiency, but it can potentially lead to a degradation compared to the original sequential algorithm's performance due to delayed feedback and reduced adaptability. We introduce a simple batch version of the Sequential Halving (SH) algorithm (Karnin et al., 2013) and provide theoretical evidence that batching does not degrade the performance of the original algorithm under practical conditions. Furthermore, we empirically validate our claim through experiments, demonstrating the robust nature of the SH algorithm in fixed-size batch settings.


title: Toward Quantum CSS-T Codes from Sparse Matrices

abstract: CSS-T codes were recently introduced as quantum error-correcting codes that respect a transversal gate. A CSS-T code depends on a pair $(C_1, C_2)$ of binary linear codes $C_1$ and $C_2$ that satisfy certain conditions. We prove that $C_1$ and $C_2$ form a CSS-T pair if and only if $C_2 \subset \operatorname{Hull}(C_1) \cap \operatorname{Hull}(C_1^2)$, where the hull of a code is the intersection of the code with its dual. We show that if $(C_1,C_2)$ is a CSS-T pair, and the code $C_2$ is degenerated on $\{i\}$, meaning that the $i^{th}$-entry is zero for all the elements in $C_2$, then the pair of punctured codes $(C_1|_i,C_2|_i)$ is also a CSS-T pair. Finally, we provide Magma code based on our results and quasi-cyclic codes as a step toward finding quantum LDPC or LDGM CSS-T codes computationally.


title: InterpreTabNet: Distilling Predictive Signals from Tabular Data by Salient Feature Interpretation

abstract: Tabular data are omnipresent in various sectors of industries. Neural networks for tabular data such as TabNet have been proposed to make predictions while leveraging the attention mechanism for interpretability. However, the inferred attention masks are often dense, making it challenging to come up with rationales about the predictive signal. To remedy this, we propose InterpreTabNet, a variant of the TabNet model that models the attention mechanism as a latent variable sampled from a Gumbel-Softmax distribution. This enables us to regularize the model to learn distinct concepts in the attention masks via a KL Divergence regularizer. It prevents overlapping feature selection by promoting sparsity which maximizes the model's efficacy and improves interpretability to determine the important features when predicting the outcome. To assist in the interpretation of feature interdependencies from our model, we employ a large language model (GPT-4) and use prompt engineering to map from the learned feature mask onto natural language text describing the learned signal. Through comprehensive experiments on real-world datasets, we demonstrate that InterpreTabNet outperforms previous methods for interpreting tabular data while attaining competitive accuracy.


title: You Only Need Less Attention at Each Stage in Vision Transformers

abstract: The advent of Vision Transformers (ViTs) marks a substantial paradigm shift in the realm of computer vision. ViTs capture the global information of images through self-attention modules, which perform dot product computations among patchified image tokens. While self-attention modules empower ViTs to capture long-range dependencies, the computational complexity grows quadratically with the number of tokens, which is a major hindrance to the practical application of ViTs. Moreover, the self-attention mechanism in deep ViTs is also susceptible to the attention saturation issue. Accordingly, we argue against the necessity of computing the attention scores in every layer, and we propose the Less-Attention Vision Transformer (LaViT), which computes only a few attention operations at each stage and calculates the subsequent feature alignments in other layers via attention transformations that leverage the previously calculated attention scores. This novel approach can mitigate two primary issues plaguing traditional self-attention modules: the heavy computational burden and attention saturation. Our proposed architecture offers superior efficiency and ease of implementation, merely requiring matrix multiplications that are highly optimized in contemporary deep learning frameworks. Moreover, our architecture demonstrates exceptional performance across various vision tasks including classification, detection and segmentation.


title: Observation of complex organic molecules containing peptide-like bonds towards hot core G358.93$-$0.03 MM1

abstract: In the star formation regions, the complex organic molecules that contain peptide bonds ($-$NH$-$C(=O)$-$) play a major role in the metabolic process because $-$NH$-$C(=O)$-$ is connected to amino acids (R-CHNH$_{2}$$-$COOH). Over the past few decades, many complex organic molecules containing peptide-like bonds have been detected in hot molecular cores, hot corinos, and cold molecular clouds, however, their prebiotic chemistry is poorly understood. We present the first detection of the rotational emission lines of formamide (NH$_{2}$CHO) and isocyanic acid (HNCO), which contain peptide-like bonds towards the chemically rich hot molecular core G358.93$-$0.03 MM1, using high-resolution and high-sensitivity Atacama Large Millimeter/submillimeter Array (ALMA) bands 6 and 7. We estimate that the column densities of NH$_{2}$CHO and HNCO towards G358.93$-$0.03 MM1 are (2.80$\pm$0.29)$\times$10$^{15}$ cm$^{-2}$ and (1.80$\pm$0.42)$\times$10$^{16}$ cm$^{-2}$ with excitation temperatures of 165$\pm$21 K and 170$\pm$32 K, respectively. The fractional abundances of NH$_{2}$CHO and HNCO towards G358.93$-$0.03 MM1 are (9.03$\pm$1.44)$\times$10$^{-10}$ and (5.80$\pm$2.09)$\times$10$^{-9}$. We compare the estimated abundances of NH$_{2}$CHO and HNCO with the existing three-phase warm-up chemical model abundance values and notice that the observed and modelled abundances are very close. We conclude that NH$_{2}$CHO is produced by the reaction of NH$_{2}$ and H$_{2}$CO in the gas phase towards G358.93$-$0.03 MM1. Likewise, HNCO is produced on the surface of grains by the reaction of NH and CO towards G358.93$-$0.03 MM1. We also found that NH$_{2}$CHO and HNCO are chemically linked towards G358.93$-$0.03 MM1.


title: Towards Generalizable Multi-Object Tracking

abstract: Multi-Object Tracking MOT encompasses various tracking scenarios, each characterized by unique traits. Effective trackers should demonstrate a high degree of generalizability across diverse scenarios. However, existing trackers struggle to accommodate all aspects or necessitate hypothesis and experimentation to customize the association information motion and or appearance for a given scenario, leading to narrowly tailored solutions with limited generalizability. In this paper, we investigate the factors that influence trackers generalization to different scenarios and concretize them into a set of tracking scenario attributes to guide the design of more generalizable trackers. Furthermore, we propose a point-wise to instance-wise relation framework for MOT, i.e., GeneralTrack, which can generalize across diverse scenarios while eliminating the need to balance motion and appearance. Thanks to its superior generalizability, our proposed GeneralTrack achieves state-of-the-art performance on multiple benchmarks and demonstrates the potential for domain generalization. https://github.com/qinzheng2000/GeneralTrack.git


title: Evaluating Uncertainty-based Failure Detection for Closed-Loop LLM Planners

abstract: Recently, Large Language Models (LLMs) have witnessed remarkable performance as zero-shot task planners for robotic manipulation tasks. However, the open-loop nature of previous works makes LLM-based planning error-prone and fragile. On the other hand, failure detection approaches for closed-loop planning are often limited by task-specific heuristics or following an unrealistic assumption that the prediction is trustworthy all the time. As a general-purpose reasoning machine, LLMs or Multimodal Large Language Models (MLLMs) are promising for detecting failures. However, However, the appropriateness of the aforementioned assumption diminishes due to the notorious hullucination problem. In this work, we attempt to mitigate these issues by introducing a framework for closed-loop LLM-based planning called KnowLoop, backed by an uncertainty-based MLLMs failure detector, which is agnostic to any used MLLMs or LLMs. Specifically, we evaluate three different ways for quantifying the uncertainty of MLLMs, namely token probability, entropy, and self-explained confidence as primary metrics based on three carefully designed representative prompting strategies. With a self-collected dataset including various manipulation tasks and an LLM-based robot system, our experiments demonstrate that token probability and entropy are more reflective compared to self-explained confidence. By setting an appropriate threshold to filter out uncertain predictions and seek human help actively, the accuracy of failure detection can be significantly enhanced. This improvement boosts the effectiveness of closed-loop planning and the overall success rate of tasks.


title: SpaFL: Communication-Efficient Federated Learning with Sparse Models and Low computational Overhead

abstract: The large communication and computation overhead of federated learning (FL) is one of the main challenges facing its practical deployment over resource-constrained clients and systems. In this work, SpaFL: a communication-efficient FL framework is proposed to optimize sparse model structures with low computational overhead. In SpaFL, a trainable threshold is defined for each filter/neuron to prune its all connected parameters, thereby leading to structured sparsity. To optimize the pruning process itself, only thresholds are communicated between a server and clients instead of parameters, thereby learning how to prune. Further, global thresholds are used to update model parameters by extracting aggregated parameter importance. The generalization bound of SpaFL is also derived, thereby proving key insights on the relation between sparsity and performance. Experimental results show that SpaFL improves accuracy while requiring much less communication and computing resources compared to sparse baselines.


title: Localize, Understand, Collaborate: Semantic-Aware Dragging via Intention Reasoner

abstract: Flexible and accurate drag-based editing is a challenging task that has recently garnered significant attention. Current methods typically model this problem as automatically learning ``how to drag'' through point dragging and often produce one deterministic estimation, which presents two key limitations: 1) Overlooking the inherently ill-posed nature of drag-based editing, where multiple results may correspond to a given input, as illustrated in Fig.1; 2) Ignoring the constraint of image quality, which may lead to unexpected distortion. To alleviate this, we propose LucidDrag, which shifts the focus from ``how to drag'' to a paradigm of ``what-then-how''. LucidDrag comprises an intention reasoner and a collaborative guidance sampling mechanism. The former infers several optimal editing strategies, identifying what content and what semantic direction to be edited. Based on the former, the latter addresses "how to drag" by collaboratively integrating existing editing guidance with the newly proposed semantic guidance and quality guidance. Specifically, semantic guidance is derived by establishing a semantic editing direction based on reasoned intentions, while quality guidance is achieved through classifier guidance using an image fidelity discriminator. Both qualitative and quantitative comparisons demonstrate the superiority of LucidDrag over previous methods. The code will be released.


title: Periodic Waves for the Regularized Camassa-Holm Equation: Existence and Spectral Stability

abstract: In this paper, we consider the existence and spectral stability of periodic traveling wave solutions for the regularized Camassa-Holm equation. For the existence of periodic waves, we employ tools from bifurcation theory to construct waves with the zero mean property and prove that waves with the same property may not exist for the well known Camassa-Holm equation. Regarding the spectral stability, we analyze the difference between the number of negative eigenvalues of a convenient linear operator, restricted to the space constituted by zero-mean periodic functions, and the number of negative eigenvalues of the matrix formed by the tangent space associated with the low-order conserved quantities of the evolution model. We also discuss the problem of orbital stability in the energy space.


title: MoDGS: Dynamic Gaussian Splatting from Causually-captured Monocular Videos

abstract: In this paper, we propose MoDGS, a new pipeline to render novel-view images in dynamic scenes using only casually captured monocular videos. Previous monocular dynamic NeRF or Gaussian Splatting methods strongly rely on the rapid movement of input cameras to construct multiview consistency but fail to reconstruct dynamic scenes on casually captured input videos whose cameras are static or move slowly. To address this challenging task, MoDGS adopts recent single-view depth estimation methods to guide the learning of the dynamic scene. Then, a novel 3D-aware initialization method is proposed to learn a reasonable deformation field and a new robust depth loss is proposed to guide the learning of dynamic scene geometry. Comprehensive experiments demonstrate that MoDGS is able to render high-quality novel view images of dynamic scenes from just a casually captured monocular video, which outperforms baseline methods by a significant margin.


title: Modelling Non-monotone Risk Aversion and Convex Compensation in Incomplete Markets

abstract: In hedge funds, convex compensation schemes are popular to stimulate a high-profit performance for portfolio managers. In economics, non-monotone risk aversion is proposed to argue that individuals may not be risk-averse when the wealth level is low. Combining these two ingredients, we study the optimal control strategy of the manager in incomplete markets. Generally, we propose a wide class of utility functions, the Piecewise Symmetric Asymptotic Hyperbolic Absolute Risk Aversion (PSAHARA) utility, to model the two ingredients, containing both non-concavity and non-differentiability as some abnormalities. Significantly, we derive an explicit optimal control for the family of PSAHARA utilities. This control is expressed into a unified four-term structure, featuring the asymptotic Merton term and the risk adjustment term. Furthermore, we provide a detailed asymptotic analysis and numerical illustration of the optimal portfolio. We obtain the following key insights: (i) A manager with the PSAHARA utility becomes extremely risk-seeking when his/her wealth level tends to zero; (ii) The optimal investment ratio tends to the Merton constant as the wealth level approaches infinity and the negative Merton constant when the wealth falls to negative infinity, implying that such a manager takes a risk-seeking investment as the wealth falls negatively low; (iii) The convex compensation still induces a great risk-taking behavior in the case that the preference is modeled by SAHARA utility. Finally, we conduct a real-data analysis of the U.S. stock market under the above model and conclude that the PSAHARA portfolio is very risk-seeking and leads to a high return and a high volatility (two-peak Sharpe ratio).


title: A computationally efficient arc-search interior-point algorithm for nonlinear constrained optimization

abstract: This paper proposes an arc-search interior-point algorithm for the nonlinear constrained optimization problem. The proposed algorithm uses the second-order derivatives to construct a search arc that approaches the optimizer. Because the arc stays in the interior set longer than any straight line, it is expected that the scheme will generate a better new iterate than a line search method. The computation of the second-order derivatives requires to solve the second linear system of equations, but the coefficient matrix of the second linear system of equations is the same as the first linear system of equations. Therefore, the matrix decomposition obtained while solving the first linear system of equations can be reused. In addition, most elements of the right-hand side vector of the second linear system of equations are already computed when the coefficient matrix is assembled. Therefore, the computation cost for solving the second linear system of equations is insignificant and the benefit of having a better search scheme is well justified. The convergence of the proposed algorithm is established. Some preliminary test results are reported to demonstrate the merit of the proposed algorithm.


title: Structural and algorithmic results for stable cycles and partitions in the Roommates problem

abstract: An instance of the Stable Roommates problem involves a set of agents, each with ordinal preferences over the others. We seek a stable matching, in which no two agents have an incentive to deviate from their assignment. It is well known that a stable matching is unlikely to exist for instances with a large number of agents. However, stable partitions always exist and provide a succinct certificate for the unsolvability of an instance, although their significance extends beyond this. They are also a useful structural tool to study the problem and correspond to half-matchings in which the agents are in a stable equilibrium. In this paper, we investigate the stable partition structure further and show how to efficiently enumerate all stable partitions and the cycles included in such structures. Furthermore, we adapt known fairness and optimality criteria from stable matchings to stable partitions. As there can be an exponential number of stable partitions, we investigate the complexity of computing different "fair" and "optimal" stable partitions directly. While a minimum-regret stable partition always exists and can be computed in linear time, we prove the NP-hardness of finding five other kinds of stable partitions that are "optimal" regarding their profile (measuring the number of first, second, third, etc., choices assigned). Furthermore, we give 2-approximation algorithms for two of the optimal stable partition problems and show the inapproximability within any constant factor for another. Through this research, we contribute to a deeper understanding of stable partitions from a combinatorial and complexity point of view, closing the gap between integral and fractional stable matchings.


title: Stein Random Feature Regression

abstract: In large-scale regression problems, random Fourier features (RFFs) have significantly enhanced the computational scalability and flexibility of Gaussian processes (GPs) by defining kernels through their spectral density, from which a finite set of Monte Carlo samples can be used to form an approximate low-rank GP. However, the efficacy of RFFs in kernel approximation and Bayesian kernel learning depends on the ability to tractably sample the kernel spectral measure and the quality of the generated samples. We introduce Stein random features (SRF), leveraging Stein variational gradient descent, which can be used to both generate high-quality RFF samples of known spectral densities as well as flexibly and efficiently approximate traditionally non-analytical spectral measure posteriors. SRFs require only the evaluation of log-probability gradients to perform both kernel approximation and Bayesian kernel learning that results in superior performance over traditional approaches. We empirically validate the effectiveness of SRFs by comparing them to baselines on kernel approximation and well-known GP regression problems.


title: Learning Manipulation by Predicting Interaction

abstract: Representation learning approaches for robotic manipulation have boomed in recent years. Due to the scarcity of in-domain robot data, prevailing methodologies tend to leverage large-scale human video datasets to extract generalizable features for visuomotor policy learning. Despite the progress achieved, prior endeavors disregard the interactive dynamics that capture behavior patterns and physical interaction during the manipulation process, resulting in an inadequate understanding of the relationship between objects and the environment. To this end, we propose a general pre-training pipeline that learns Manipulation by Predicting the Interaction (MPI) and enhances the visual representation.Given a pair of keyframes representing the initial and final states, along with language instructions, our algorithm predicts the transition frame and detects the interaction object, respectively. These two learning objectives achieve superior comprehension towards "how-to-interact" and "where-to-interact". We conduct a comprehensive evaluation of several challenging robotic tasks.The experimental results demonstrate that MPI exhibits remarkable improvement by 10% to 64% compared with previous state-of-the-art in real-world robot platforms as well as simulation environments. Code and checkpoints are publicly shared at https://github.com/OpenDriveLab/MPI.


title: Topo4D: Topology-Preserving Gaussian Splatting for High-Fidelity 4D Head Capture

abstract: 4D head capture aims to generate dynamic topological meshes and corresponding texture maps from videos, which is widely utilized in movies and games for its ability to simulate facial muscle movements and recover dynamic textures in pore-squeezing. The industry often adopts the method involving multi-view stereo and non-rigid alignment. However, this approach is prone to errors and heavily reliant on time-consuming manual processing by artists. To simplify this process, we propose Topo4D, a novel framework for automatic geometry and texture generation, which optimizes densely aligned 4D heads and 8K texture maps directly from calibrated multi-view time-series images. Specifically, we first represent the time-series faces as a set of dynamic 3D Gaussians with fixed topology in which the Gaussian centers are bound to the mesh vertices. Afterward, we perform alternative geometry and texture optimization frame-by-frame for high-quality geometry and texture learning while maintaining temporal topology stability. Finally, we can extract dynamic facial meshes in regular wiring arrangement and high-fidelity textures with pore-level details from the learned Gaussians. Extensive experiments show that our method achieves superior results than the current SOTA face reconstruction methods both in the quality of meshes and textures. Project page: https://xuanchenli.github.io/Topo4D/.


title: Neural Polarization: Toward Electron Density for Molecules by Extending Equivariant Networks

abstract: Recent SO(3)-equivariant models embedded a molecule as a set of single atoms fixed in the three-dimensional space, which is analogous to a ball-and-stick view. This perspective provides a concise view of atom arrangements, however, the surrounding electron density cannot be represented and its polarization effects may be underestimated. To overcome this limitation, we propose \textit{Neural Polarization}, a novel method extending equivariant network by embedding each atom as a pair of fixed and moving points. Motivated by density functional theory, Neural Polarization represents molecules as a space-filling view which includes an electron density, in contrast with a ball-and-stick view. Neural Polarization can flexibly be applied to most type of existing equivariant models. We showed that Neural Polarization can improve prediction performances of existing models over a wide range of targets. Finally, we verified that our method can improve the expressiveness and equivariance in terms of mathematical aspects.


title: Optimizing hydrogen and e-methanol production through Power-to-X integration in biogas plants

abstract: The European Union strategy for net zero emissions relies on developing hydrogen and electro fuels infrastructure. These fuels will be crucial as energy carriers and balancing agents for renewable energy variability. Large scale production requires more renewable capacity, and various Power to X (PtX) concepts are emerging in renewable rich countries. However, sourcing renewable carbon to scale carbon based electro fuels is a significant challenge. This study explores a PtX hub that sources renewable CO2 from biogas plants, integrating renewable energy, hydrogen production, and methanol synthesis on site. This concept creates an internal market for energy and materials, interfacing with the external energy system. The size and operation of the PtX hub were optimized, considering integration with local energy systems and a potential hydrogen grid. The levelized costs of hydrogen and methanol were estimated for a 2030 start, considering new legislation on renewable fuels of non biological origin (RFNBOs). Our results show the PtX hub can rely mainly on on site renewable energy, selling excess electricity to the grid. A local hydrogen grid connection improves operations, and the behind the meter market lowers energy prices, buffering against market variability. We found methanol costs could be below 650 euros per ton and hydrogen production costs below 3 euros per kg, with standalone methanol plants costing 23 per cent more. The CO2 recovery to methanol production ratio is crucial, with over 90 per cent recovery requiring significant investment in CO2 and H2 storage. Overall, our findings support planning PtX infrastructures integrated with the agricultural sector as a cost effective way to access renewable carbon.


title: Generating 3D Terrain with 2D Cellular Automata

abstract: This paper presents an initial exploration on the use of 2D cellular automata (CA) for generating 3D terrains through a simple yet effective additive approach. By experimenting with multiple CA transition rules, this preliminary investigation yielded aesthetically interesting landscapes, hinting at the technique's potential applicability for real-time terrain generation in games.


title: Exploring Channel Estimation and Signal Detection for ODDM-based ISAC Systems

abstract: Inspired by providing reliable communications for high-mobility scenarios, in this letter, we investigate the channel estimation and signal detection in integrated sensing and communication~(ISAC) systems based on the orthogonal delay-Doppler multiplexing~(ODDM) modulation, which consists of a pulse-train that can achieve the orthogonality with respect to the resolution of the delay-Doppler~(DD) plane. To enhance the communication performance in the ODDM-based ISAC systems, we first propose a low-complexity approximation algorithm for channel estimation, which addresses the challenge of the high complexity from high resolution in the ODDM modulation, and achieves performance close to that of the maximum likelihood estimator scheme. Then, we employ the orthogonal approximate message-passing scheme to detect the symbols in the communication process based on the estimated channel information. Finally, simulation results show that the detection performance of ODDM is better than other multi-carrier modulation schemes. Specifically, the ODDM outperforms the orthogonal time frequency space scheme by 2.3 dB when the bit error ratio is $10^{-6}$.


title: Nucleon Consumption and Mass-Energy Conversion Induced by Dark Matter

abstract: We propose the nucleon consumption induced by dark matter as a new scenario to overcome the energy threshold of direct detection. It can be realized with proton ($\chi + p \rightarrow \chi + \ell^+$) or neutron ($\chi + n \rightarrow \chi + \nu$) target. Both effective operators and concrete models are provided to illustrate the idea. Since the initial DM and nucleon velocity is only $10^{-3}$ and $1/4$ of the speed of light, respectively, the cross section and hence event rate are determined by the involved particle masses and not affected by the nucleon Fermi motion. Of the two realizations, the proton consumption has richer phenomena with both charged lepton and the daughter nuclei de-excitation to allow double or even triple coincidence to significantly suppress the background. We also illustrate the projected sensitivities at DM and neutrino experiments such as PandaX-4T, DUNE, JUNO, and Hyper-K.


title: GLCAN: Global-Local Collaborative Auxiliary Network for Local Learning

abstract: Traditional deep neural networks typically use end-to-end backpropagation, which often places a big burden on GPU memory. Another promising training method is local learning, which involves splitting the network into blocks and training them in parallel with the help of an auxiliary network. Local learning has been widely studied and applied to image classification tasks, and its performance is comparable to that of end-to-end method. However, different image tasks often rely on different feature representations, which is difficult for typical auxiliary networks to adapt to. To solve this problem, we propose the construction method of Global-Local Collaborative Auxiliary Network (GLCAN), which provides a macroscopic design approach for auxiliary networks. This is the first demonstration that local learning methods can be successfully applied to other tasks such as object detection and super-resolution. GLCAN not only saves a lot of GPU memory, but also has comparable performance to an end-to-end approach on data sets for multiple different tasks.


title: DroneVis: Versatile Computer Vision Library for Drones

abstract: This paper introduces DroneVis, a novel library designed to automate computer vision algorithms on Parrot drones. DroneVis offers a versatile set of features and provides a diverse range of computer vision tasks along with a variety of models to choose from. Implemented in Python, the library adheres to high-quality code standards, facilitating effortless customization and feature expansion according to user requirements. In addition, comprehensive documentation is provided, encompassing usage guidelines and illustrative use cases. Our documentation, code, and examples are available in https://github.com/ahmedheakl/drone-vis.


title: Bilateral Guided Radiance Field Processing

abstract: Neural Radiance Fields (NeRF) achieves unprecedented performance in synthesizing novel view synthesis, utilizing multi-view consistency. When capturing multiple inputs, image signal processing (ISP) in modern cameras will independently enhance them, including exposure adjustment, color correction, local tone mapping, etc. While these processings greatly improve image quality, they often break the multi-view consistency assumption, leading to "floaters" in the reconstructed radiance fields. To address this concern without compromising visual aesthetics, we aim to first disentangle the enhancement by ISP at the NeRF training stage and re-apply user-desired enhancements to the reconstructed radiance fields at the finishing stage. Furthermore, to make the re-applied enhancements consistent between novel views, we need to perform imaging signal processing in 3D space (i.e. "3D ISP"). For this goal, we adopt the bilateral grid, a locally-affine model, as a generalized representation of ISP processing. Specifically, we optimize per-view 3D bilateral grids with radiance fields to approximate the effects of camera pipelines for each input view. To achieve user-adjustable 3D finishing, we propose to learn a low-rank 4D bilateral grid from a given single view edit, lifting photo enhancements to the whole 3D scene. We demonstrate our approach can boost the visual quality of novel view synthesis by effectively removing floaters and performing enhancements from user retouching. The source code and our data are available at: https://bilarfpro.github.io.


title: Dual Hyperspectral Mamba for Efficient Spectral Compressive Imaging

abstract: Deep unfolding methods have made impressive progress in restoring 3D hyperspectral images (HSIs) from 2D measurements through convolution neural networks or Transformers in spectral compressive imaging. However, they cannot efficiently capture long-range dependencies using global receptive fields, which significantly limits their performance in HSI reconstruction. Moreover, these methods may suffer from local context neglect if we directly utilize Mamba to unfold a 2D feature map as a 1D sequence for modeling global long-range dependencies. To address these challenges, we propose a novel Dual Hyperspectral Mamba (DHM) to explore both global long-range dependencies and local contexts for efficient HSI reconstruction. After learning informative parameters to estimate degradation patterns of the CASSI system, we use them to scale the linear projection and offer noise level for the denoiser (i.e., our proposed DHM). Specifically, our DHM consists of multiple dual hyperspectral S4 blocks (DHSBs) to restore original HSIs. Particularly, each DHSB contains a global hyperspectral S4 block (GHSB) to model long-range dependencies across the entire high-resolution HSIs using global receptive fields, and a local hyperspectral S4 block (LHSB) to address local context neglect by establishing structured state-space sequence (S4) models within local windows. Experiments verify the benefits of our DHM for HSI reconstruction. The source codes and models will be available at https://github.com/JiahuaDong/DHM.


title: Critical curve for a weakly coupled system of semi-linear $\sigma$-evolution equations with different damping types

abstract: In this paper, we would like to consider the Cauchy problem for a weakly coupled system of semi linear $sigma$ evolution equations with different damping mechanisms for any $\sigma>1$, parabolic like damping and $\sigma$ evolution like damping. Motivated strongly by the well known Nakao's problem, the main goal of this work is to determine the critical curve between the power exponents $p$ and $q$ of nonlinear terms by not only establishing the global well posedness property of small data solutions but also indicating blow up in finite time solutions. We want to point out that the application of a modified test function associated with a judicious choice of test functions really plays an essential role to show a blow up result for solutions and upper bound estimates for lifespan of solutions, where $\sigma$ is assumed to be any fractional number. To end this paper, lower bound estimates for lifespan of solutions are also shown to verify their sharp results in some spatial dimensions


title: Task Planning for Object Rearrangement in Multi-room Environments

abstract: Object rearrangement in a multi-room setup should produce a reasonable plan that reduces the agent's overall travel and the number of steps. Recent state-of-the-art methods fail to produce such plans because they rely on explicit exploration for discovering unseen objects due to partial observability and a heuristic planner to sequence the actions for rearrangement. This paper proposes a novel hierarchical task planner to efficiently plan a sequence of actions to discover unseen objects and rearrange misplaced objects within an untidy house to achieve a desired tidy state. The proposed method introduces several novel techniques, including (i) a method for discovering unseen objects using commonsense knowledge from large language models, (ii) a collision resolution and buffer prediction method based on Cross-Entropy Method to handle blocked goal and swap cases, (iii) a directed spatial graph-based state space for scalability, and (iv) deep reinforcement learning (RL) for producing an efficient planner. The planner interleaves the discovery of unseen objects and rearrangement to minimize the number of steps taken and overall traversal of the agent. The paper also presents new metrics and a benchmark dataset called MoPOR to evaluate the effectiveness of the rearrangement planning in a multi-room setting. The experimental results demonstrate that the proposed method effectively addresses the multi-room rearrangement problem.


title: Towards a Unified Framework of Clustering-based Anomaly Detection

abstract: Unsupervised Anomaly Detection (UAD) plays a crucial role in identifying abnormal patterns within data without labeled examples, holding significant practical implications across various domains. Although the individual contributions of representation learning and clustering to anomaly detection are well-established, their interdependencies remain under-explored due to the absence of a unified theoretical framework. Consequently, their collective potential to enhance anomaly detection performance remains largely untapped. To bridge this gap, in this paper, we propose a novel probabilistic mixture model for anomaly detection to establish a theoretical connection among representation learning, clustering, and anomaly detection. By maximizing a novel anomaly-aware data likelihood, representation learning and clustering can effectively reduce the adverse impact of anomalous data and collaboratively benefit anomaly detection. Meanwhile, a theoretically substantiated anomaly score is naturally derived from this framework. Lastly, drawing inspiration from gravitational analysis in physics, we have devised an improved anomaly score that more effectively harnesses the combined power of representation learning and clustering. Extensive experiments, involving 17 baseline methods across 30 diverse datasets, validate the effectiveness and generalization capability of the proposed method, surpassing state-of-the-art methods.


title: On the number of solutions to a random instance of the permuted kernel problem

abstract: The Permuted Kernel Problem (PKP) is a problem in linear algebra that was first introduced by Shamir in 1989. Roughly speaking, given an $\ell \times m$ matrix $\mathbf{A}$ and an $m \times 1$ vector $\mathbf{b}$ over a finite field of $q$ elements $\mathbb{F}_q$, the PKP asks to find an $m \times m$ permutation matrix $\mathbf{\pi}$ such that $\mathbf{\pi} \mathbf{b}$ belongs to the kernel of $\mathbf{A}$. In recent years, several post-quantum digital signature schemes whose security can be provably reduced to the hardness of solving random instances of the PKP have been proposed. In this regard, it is important to know the expected number of solutions to a random instance of the PKP in terms of the parameters $q,\ell,m$. Previous works have heuristically estimated the expected number of solutions to be $m! / q^\ell$. We provide, and rigorously prove, exact formulas for the expected number of solutions to a random instance of the PKP and the related Inhomogeneous Permuted Kernel Problem (IPKP), considering two natural ways of generating random instances.


title: Gamma-ray burst Jet Progenitor: long vs short bursts by angular momentum and mass ratio

abstract: In this study, we investigate the homologous collapse dynamics of a slowly rotating stellar nuclear core. We incorporate the virial theorem of hadron collisional relaxations to analyze the conversion of gravitational potential energy into kinetic energy of hadrons. Additionally, we consider the production of photons and electron-positron pairs resulting from hadron collisions. Our analysis reveals a gravo-thermal process wherein gravitational energy transforms into energy associated with photons and pairs. The presence of axial symmetric centrifugal potential reduces the gravitational potential energy gain. The presence of axial symmetric centrifugal potential mitigates the gain in gravitational potential energy. Consequently, we observe the formation of highly energetic and opaque photon-pair jets, whose size, peak spectra, energy and number densities are consistent with observed energetic features and empirical relationships of Gamma-Ray Burst (GRB) progenitors. Furthermore, we find that the angular momentum and mass ratio ($J/M$) of the collapsing core and binary coalescence play crucial roles in determining the jet angle and the differentiation between short and long bursts. Our findings contribute to a deeper understanding of the mechanisms governing GRBs' progenitor systems.


title: Games under the Tiered Deferred Acceptance Mechanism

abstract: We study a multi-stage admission system, known as the Tiered Deferred Acceptance mechanism, designed to benefit some schools over others. The current US public school and Chinese college admission systems are two examples. In this system, schools are partitioned into tiers, and the Deferred Acceptance algorithm is applied within each tier. Once assigned, students cannot apply to schools in subsequent tiers. This mechanism is not strategyproof. Therefore, we study the Nash equilibria of the induced preference revelation game. We show that Nash equilibrium outcomes are nested in the sense that merging tiers preserves all equilibrium outcomes. We also identify within-tier acyclicity as a necessary and sufficient condition for the mechanism to implement stable matchings in equilibrium. Our findings suggest that transitioning from the Deferred Acceptance mechanism to the Tiered Deferred Acceptance mechanism may not improve student quality at top-tier schools as intended.


title: Mix-of-Granularity: Optimize the Chunking Granularity for Retrieval-Augmented Generation

abstract: Integrating information from different reference data sources is a major challenge for Retrieval-Augmented Generation (RAG) systems because each knowledge source adopts a unique data structure and follows different conventions. Retrieving from multiple knowledge sources with one fixed strategy usually leads to under-exploitation of information. To mitigate this drawback, inspired by Mix-of-Expert, we introduce Mix-of-Granularity (MoG), a method that dynamically determines the optimal granularity of a knowledge database based on input queries using a router. The router is efficiently trained with a newly proposed loss function employing soft labels. We further extend MoG to Mix-of-Granularity-Graph (MoGG), where reference documents are pre-processed into graphs, enabling the retrieval of relevant information from distantly situated chunks. Extensive experiments demonstrate that both MoG and MoGG effectively predict optimal granularity levels, significantly enhancing the performance of the RAG system in downstream tasks. The code of both MoG and MoGG will be made public.


title: The Curious Case of End Token: A Zero-Shot Disentangled Image Editing using CLIP

abstract: Diffusion models have become prominent in creating high-quality images. However, unlike GAN models celebrated for their ability to edit images in a disentangled manner, diffusion-based text-to-image models struggle to achieve the same level of precise attribute manipulation without compromising image coherence. In this paper, CLIP which is often used in popular text-to-image diffusion models such as Stable Diffusion is capable of performing disentangled editing in a zero-shot manner. Through both qualitative and quantitative comparisons with state-of-the-art editing methods, we show that our approach yields competitive results. This insight may open opportunities for applying this method to various tasks, including image and video editing, providing a lightweight and efficient approach for disentangled editing.


title: Modeling the distribution of insulin in pancreas

abstract: Maintenance of adequate physical and functional pancreatic $\beta$-cell mass is critical for the prevention or delay of diabetes mellitus. It is well established that insulin potently activates mitogenic and anti-apoptotic signaling cascades in cultured $\beta$-cells. Loss of $\beta$-cell insulin receptors is sufficient to induce type 2 diabetes in mice. However, it remains unclear whether the {\em in vitro} effect in human islets and the {\em in vivo} effects in mice can be applied to human physiology. The major obstacle to a complete understanding of the effects of insulin's feedback in human pancreas is the absence of technology to measure the concentrations of insulin inside of pancreas. To contextualize recent {\em in vitro} data, it is essential to know the local concentration and distribution of insulin in pancreas. To this end, we continue to estimate the local insulin concentration within pancreas. In this paper, we investigate the distribution of insulin concentration along the pancreatic vein through a novel mathematical modeling approach using existing physiological data and islet imaging data, in contrast to our previous work focusing on the insulin level within an islet. Our studies suggest that, in response to an increase in glucose, the insulin concentration along the pancreatic vein increases nearly linearly in the fashion of increasing quicker in tail area but slower in head area depending of the initial distribution.


title: Machine Learning Methods for Pricing Financial Derivatives

abstract: Stochastic differential equation (SDE) models are the foundation for pricing and hedging financial derivatives. The drift and volatility functions in SDE models are typically chosen to be algebraic functions with a small number (less than 5) parameters which can be calibrated to market data. A more flexible approach is to use neural networks to model the drift and volatility functions, which provides more degrees-of-freedom to match observed market data. Training of models requires optimizing over an SDE, which is computationally challenging. For European options, we develop a fast stochastic gradient descent (SGD) algorithm for training the neural network-SDE model. Our SGD algorithm uses two independent SDE paths to obtain an unbiased estimate of the direction of steepest descent. For American options, we optimize over the corresponding Kolmogorov partial differential equation (PDE). The neural network appears as coefficient functions in the PDE. Models are trained on large datasets (many contracts), requiring either large simulations (many Monte Carlo samples for the stock price paths) or large numbers of PDEs (a PDE must be solved for each contract). Numerical results are presented for real market data including S&P 500 index options, S&P 100 index options, and single-stock American options. The neural-network-based SDE models are compared against the Black-Scholes model, the Dupire's local volatility model, and the Heston model. Models are evaluated in terms of how accurate they are at pricing out-of-sample financial derivatives, which is a core task in derivative pricing at financial institutions.


title: Creation and manipulation of surface code defects with quantum optimal control

abstract: The surface code is a spin-1/2 lattice system that can exhibit non-trivial topological order when defects are punctured in the lattice and thus can be used as a stabiliser code. The protocols developed to create defects in the system have previously relied on adiabatic dynamics. In this work we use techniques of quantum optimal control to overcome the requirement for adiabaticity and achieve defect creation and implemention of other important operations required for quantum computation at much faster timescales.


title: Is the Young Star Association $\epsilon$Cha Double?

abstract: The kinematics of the $\epsilon$ Cha young stellar association close to the Sun has been studied based on a list of candidate stars from the Dickson-Vandervelde work. The working sample consists of 26 stars with parallaxes, proper motions from the Gaia~DR3 catalog and radial velocities taken from literary sources. The orbits of the stars back to the past were constructed, and the moment when the association had a minimum spatial size was determined, as well as an analysis of the dependencies of the velocities $U,V,W$ on the coordinates $x,y,z$ was carried out. It is shown that the initial sample is divided into two parts with different kinematic properties. The first sample included 9 stars. Based on the construction of the orbits of these 9 stars, an age estimate of $t=4.9\pm0.8$ million years was obtained. An expansion coefficient in the $xz$ plane with the value $K_{xz}=135\pm19$ km/s/kpc was also found for them, on the basis of which another age estimate $t=7.2\pm1.0$ million years was obtained. The second sample included 17 stars. The construction of their orbits gave an estimate of age $t=0.2\pm0.3$ million years, and based on the gradient $\partial W/\partial z=707\pm248$ km/s/kpc, a second estimate of their age $t=1.4\pm0.5$ million years was obtained. This suggests that the $\epsilon$ Cha association either consists of two groupings of different ages, or a younger one arose as a result of a recent outbreak of star formation within a common star system. The question of the gravitational connection of the groupings has not been considered in the framework of this work.


title: Temporal decay rates for weak solutions of the Navier-Stokes Equations with supercritical fractional dissipation

abstract: In this paper, we establish temporal decay for a weak solution $u(x,t)$ (with initial data $u_0$) of the Navier-Stokes equations with supercritical fractional dissipation $\alpha \in (0,\frac{5}{4})$ in $L^2(\mathbb{R}^3)$ and $\dot{H}^s(\mathbb{R}^3)$ ($s\leq0$). More precisely, we prove that $u$ satisfies the following upper bound: $$ \|u(t)\|_{2}^2\leq C(1+t)^{-\frac{3-2p}{2\alpha}}, \quad\forall t>0.$$ This estimate leads us to show the next inequality: $$ \|u(t)\|_{\dot{H}^{-\delta}}^2\leq C(1+t)^{-\frac{3-2\delta-2p}{2\alpha}}, \quad\forall t>0.$$ These results are obtained by applying standard Fourier Analysis and they hold for $\alpha\in(0,\frac{5}{4}),$ $p\in[-1,\frac{3}{2})$, $\delta\in [0, \frac{3-2p}{2})$ and $u_0\in L^2(\mathbb{R}^3)\cap \mathcal{Y}^p(\mathbb{R}^3)$ (and also $u_0\in L^1(\mathbb{R}^3)$ for $p=-1$ and a certain finite set of values of $\alpha$).


title: Certaines fibrations en surfaces quadriques r\'eelles

abstract: We consider the question whether a real threefold X fibred into quadric surfaces over the real projective line is stably rational (over R) if the topological space X(R) is connected. We give a counterexample. When all geometric fibres are irreducible, the question is open. We investigate a family of such fibrations for which the intermediate jacobian technique is not available. We produce two independent methods which in many cases enable one to prove decomposition of the diagonal.


title: Sub-wavelength optical lattice in 2D materials

abstract: Recently, light-matter interaction has been vastly expanded as a control tool for inducing and enhancing many emergent non-equilibrium phenomena. However, conventional schemes for exploring such light-induced phenomena rely on uniform and diffraction-limited free-space optics, which limits the spatial resolution and the efficiency of light-matter interaction. Here, we overcome these challenges using metasurface plasmon polaritons (MPPs) to form a sub-wavelength optical lattice. Specifically, we report a ``nonlocal" pump-probe scheme where MPPs are excited to induce a spatially modulated AC Stark shift for excitons in a monolayer of MoSe$_2$, several microns away from the illumination spot. Remarkably, we identify nearly two orders of magnitude reduction for the required modulation power compared to the free-space optical illumination counterpart. Moreover, we demonstrate a broadening of the excitons' linewidth as a robust signature of MPP-induced periodic sub-diffraction modulation. Our results open new avenues for exploring power-efficient light-induced lattice phenomena below the diffraction limit in active chip-compatible MPP architectures.


title: Intersecting families with large shadow degree

abstract: A $k$-uniform family $\mathcal{F}$ is called intersecting if $F\cap F'\neq \emptyset$ for all $F,F'\in \mathcal{F}$. The shadow family $\partial \mathcal{F}$ is the family of $(k-1)$-element sets that are contained in some members of $\mathcal{F}$. The shadow degree (or minimum positive co-degree) of $\mathcal{F}$ is defined as the maximum integer $r$ such that every $E\in \partial \mathcal{F}$ is contained in at least $r$ members of $\mathcal{F}$. In 2021, Balogh, Lemons and Palmer determined the maximum size of an intersecting $k$-uniform family with shadow degree at least $r$ for $n\geq n_0(k,r)$, where $n_0(k,r)$ is doubly exponential in $k$ for $4\leq r\leq k$. In the present paper, we present a short proof of this result for $n\geq 2(r+1)^rk \frac{\binom{2k-1}{k}}{\binom{2r-1}{r}}$ and $4\leq r\leq k$.


title: The Zappa-Sz\'{e}p product of twisted groupoids

abstract: We define and study the external and the internal Zappa-Sz\'{e}p product of twists over groupoids. We determine when a pair $(\Sigma_{1},\Sigma_{2})$ of twists over a matched pair $(\mathcal{G}_{1},\mathcal{G}_{2})$ of groupoids gives rise to a Zappa-Sz\'{e}p twist $\Sigma$ over the Zappa-Sz\'{e}p product $\mathcal{G}_{1}\bowtie\mathcal{G}_{2}$. We prove that the resulting (reduced and full) twisted groupoid C*-algebra of the Zappa-Sz\'{e}p twist $\Sigma\to \mathcal{G}_{1}\bowtie\mathcal{G}_{2}$ is a C*-blend of its subalgebras corresponding to the subtwists $\Sigma_{i}\to \mathcal{G}_{i}$. Using Kumjian-Renault theory, we then prove a converse: Any C*-blend in which the intersection of the three algebras is a Cartan subalgebra in all of them, arises as the reduced twisted groupoid C*-algebras from such a Zappa-Sz\'{e}p twist $\Sigma\to \mathcal{G}_{1}\bowtie\mathcal{G}_{2}$ of two twists $\Sigma_{1}\to \mathcal{G}_{1}$ and $\Sigma_{2}\to \mathcal{G}_{2}$.


title: Generalized Fluid Models of the Braginskii Type. Part 2. The Boltzmann Operator

abstract: In our previous paper (Hunana et al. 2022) we have employed the Landau (Coulomb, Fokker-Planck) collisional operator together with the moment method of Grad and considered various generalizations of the Braginskii model, such as a multi-fluid formulation of the 21- and 22-moment models valid for general masses and temperatures, where all of the considered moments are described by their evolution equations (with fully non-linear left-hand-sides). Here we consider the same models, however, we employ the Boltzmann operator and calculate the collisional contributions via expressing them through the Chapman-Cowling collisional integrals. These ``integrals'' just represent a useful mathematical technique/notation introduced roughly 100 years ago, which (in the usual semi-linear approximation) allows one to postpone specifying the particular collisional process and finish all of the calculations with the Boltzmann operator completely. Additionally, by considering the cases of self-collisions and $m_a\ll m_b$, we express all of the Braginskii transport coefficients through the Chapman-Cowling integrals as well. We thus offer a multi-fluid 22-moment model as well as the Braginskii model, which are valid for a large class of (elastic) collisional processes describable by the Boltzmann operator. The particular collisional process - the hard spheres, the Coulomb collisions, the Maxwell molecules, the inverse interparticle force $\sim 1/r^\nu$ (or other cases not discussed here), are specified only at the end, by simply selecting few (pure) numbers. In the Appendix, we introduce the Boltzmann operator in a way suitable for newcomers and we discuss a surprisingly simple recipe how to calculate the collisional contributions with analytic software.


title: Molecular Modelling of Aqueous Batteries

abstract: Aqueous batteries play an increasingly important role for the development of sustainable and safety-prioritised energy storage solutions. Compared to conventional lithium-ion batteries, the cell chemistry in aqueous batteries share many common features with those of electrolyzer and pseudo-capacitor systems because of the involvement of aqueous electrolyte and proton activity. This imposes the needs for a better understanding of the corresponding ion solvation, intercalation and electron transfer processes at atomistic scale. Therefore, this chapter provides an up-to-date overview of molecular modelling techniques and their applications in aqueous batteries. In particular, we emphasize on the dynamical and reactive description of aqueous battery systems brought in by density functional theory-based molecular dynamics simulation (DFTMD) and its machine-learning (ML) accelerated counterpart. Moreover, we also cover the recent advancement of generative artificial intelligence (AI) in molecular and materials design of aqueous batteries. Case studies presented here include popular aqueous battery systems, such as water-in-salt electrolytes, proton-coupled cathode materials, Zn-ion batteries as well as organic redox flow batteries.


title: Learning to Solve Multiresolution Matrix Factorization by Manifold Optimization and Evolutionary Metaheuristics

abstract: Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs with complex multiscale or hierarchical strucutre. While MMF promises to yields a useful wavelet basis, finding the factorization itself is hard, and existing greedy methods tend to be brittle. In this paper, we propose a ``learnable'' version of MMF that carfully optimizes the factorization using metaheuristics, specifically evolutionary algorithms and directed evolution, along with Stiefel manifold optimization through backpropagating errors. We show that the resulting wavelet basis far outperforms prior MMF algorithms and gives comparable performance on standard learning tasks on graphs. Furthermore, we construct the wavelet neural networks (WNNs) learning graphs on the spectral domain with the wavelet basis produced by our MMF learning algorithm. Our wavelet networks are competitive against other state-of-the-art methods in molecular graphs classification and node classification on citation graphs. We release our implementation at https://github.com/HySonLab/LearnMMF


title: MI 2 MI: Training Dyad with Collaborative Brain-Computer Interface and Cooperative Motor Imagery Tasks for Better BCI Performance

abstract: Collaborative brain-computer interface (cBCI) that conduct motor imagery (MI) among multiple users has the potential not only to improve overall BCI performance by integrating information from multiple users, but also to leverage individuals' performance in decision-making or control. However, existed research mostly focused on the brain signals changes through a single user, not noticing the possible interaction between users during the collaboration. In this work, we utilized cBCI and designed a cooperative four-classes MI task to train the dyad. A humanoid robot would stimulate the dyad to conduct both left/right hand and tongue/foot MI. Single user was asked to conduct single MI task before and after the cooperative MI task. The experiment results showed that our training could activate better performance (e.g., high quality of EEG /MI classification accuracy) for the single user than single MI task, and the single user also obtained better single MI performance after cooperative MI training.


title: Machine-learning wall-model large-eddy simulation accounting for isotropic roughness under local equilibrium

abstract: We introduce a wall model (WM) for large-eddy simulation (LES) applicable to rough surfaces with Gaussian and non-Gaussian distributions for both transitionally and fully rough regimes. The model is applicable to arbitrary complex geometries where roughness elements are assumed to be underresolved. The wall model is implemented using a feedforward neural network, with the geometric properties of the roughness topology and near-wall flow quantities serving as input. The optimal set of non-dimensional input features is identified using information theory, selecting variables that maximize information about the output while minimizing redundancy among inputs. The model incorporates a confidence score based on Gaussian process modeling, enabling the detection of low model performance for unseen rough surfaces. The model is trained using a direct numerical simulation roughness database comprising approximately 200 cases. The roughness geometries for the database are selected from a large repository through active learning. This approach ensures that the rough surfaces incorporated into the database are the most informative. The model performance is evaluated both a-priori and a-posteriori in WMLES of turbulent channel flows with rough walls. Over 120 channel flow cases are considered, including untrained roughness geometries, roughness Reynolds numbers, and grid resolutions for both transitionally- and fully-rough regimes. The results show that the rough-wall model predicts the wall shear stress within 15% accuracy. The model is also assessed on a high-pressure turbine blade with two different rough surfaces. The WM predicts the skin friction and the mean velocity deficit within 10% accuracy except the region with shock waves.


title: Financial Deepening and Economic Growth in Select Emerging Markets with Currency Board Systems: Theory and Evidence

abstract: This paper investigates some indicators of financial development in select countries with currency board systems and raises some questions about the connection between financial development and growth in currency board systems. Most of those cases are long past episodes of what we would now call emerging markets. However, the paper also looks at Hong Kong, the currency board system that is one of the world's largest and most advanced financial markets. The global financial crisis of 2008 09 created doubts about the efficiency of financial markets in advanced economies, including in Hong Kong, and unsettled the previous consensus that a large financial sector would be more stable than a smaller one.


title: Pedestrian intention prediction in Adverse Weather Conditions with Spiking Neural Networks and Dynamic Vision Sensors

abstract: This study examines the effectiveness of Spiking Neural Networks (SNNs) paired with Dynamic Vision Sensors (DVS) to improve pedestrian detection in adverse weather, a significant challenge for autonomous vehicles. Utilizing the high temporal resolution and low latency of DVS, which excels in dynamic, low-light, and high-contrast environments, we assess the efficiency of SNNs compared to traditional Convolutional Neural Networks (CNNs). Our experiments involved testing across diverse weather scenarios using a custom dataset from the CARLA simulator, mirroring real-world variability. SNN models, enhanced with Temporally Effective Batch Normalization, were trained and benchmarked against state-of-the-art CNNs to demonstrate superior accuracy and computational efficiency in complex conditions such as rain and fog. The results indicate that SNNs, integrated with DVS, significantly reduce computational overhead and improve detection accuracy in challenging conditions compared to CNNs. This highlights the potential of DVS combined with bio-inspired SNN processing to enhance autonomous vehicle perception and decision-making systems, advancing intelligent transportation systems' safety features in varying operational environments. Additionally, our research indicates that SNNs perform more efficiently in handling long perception windows and prediction tasks, rather than simple pedestrian detection.


title: Adapting Fine-Grained Cross-View Localization to Areas without Fine Ground Truth

abstract: Given a ground-level query image and a geo-referenced aerial image that covers the query's local surroundings, fine-grained cross-view localization aims to estimate the location of the ground camera inside the aerial image. Recent works have focused on developing advanced networks trained with accurate ground truth (GT) locations of ground images. However, the trained models always suffer a performance drop when applied to images in a new target area that differs from training. In most deployment scenarios, acquiring fine GT, i.e. accurate GT locations, for target-area images to re-train the network can be expensive and sometimes infeasible. In contrast, collecting images with noisy GT with errors of tens of meters is often easy. Motivated by this, our paper focuses on improving the performance of a trained model in a new target area by leveraging only the target-area images without fine GT. We propose a weakly supervised learning approach based on knowledge self-distillation. This approach uses predictions from a pre-trained model as pseudo GT to supervise a copy of itself. Our approach includes a mode-based pseudo GT generation for reducing uncertainty in pseudo GT and an outlier filtering method to remove unreliable pseudo GT. Our approach is validated using two recent state-of-the-art models on two benchmarks. The results demonstrate that it consistently and considerably boosts the localization accuracy in the target area.


title: The new $Z'$ boson of the Bestest Little Higgs Model as a portal to signatures of Higgs bosons $h_0$ and $H_0$ at the future muon collider

abstract: We study the new $Z'$ boson as a portal for the production of Higgs bosons $h_0$ and $H_0$ predicted by the Bestest Little Higgs Model through the Higgs-strahlung processes $\mu^+\mu^- \to (Z, Z') \to Zh_0, ZH_0$. We focus on the resonance and non-resonance effects of the $Zh_0, ZH_0$ signals. In our analysis, we consider the center-of-mass energies of $\sqrt{s}=3, 4, 5, 6, 7, 10, 30$ TeV and integrated luminosities of ${\cal L}=2, 4, 6, 10, 30$ ${\rm ab^{-1}}$ projected for a future muon collider. The possibility of performing precision measurements for the Higgs bosons $h_0$ and $H_0$ is very promising at the future muon collider. Furthermore, our results may be helpful to the High Energy Physics community. Complementarily, we generate and provide the Feynman rules necessary for studying the processes $\mu^+\mu^- \to (Z, Z') \to Zh_0, ZH_0$.


title: Revisiting Energy Distribution and Formation Rate of CHIME Fast Radio Bursts

abstract: Using a large sample of fast radio bursts (FRBs) from the first CHIME/FRB catalog, we apply the Lynden-Bell's c$^-$ method to study their energy function and formation rate evolutions with redshift. It is found with the non-parametric Kendell's $\tau$ statistics that the FRB energy strongly evolves with the cosmological redshift as $E(z)\propto(1 + z)^{5.23}$. After removing the redshift dependence, the local energy distribution can be described by a broken power-law form of $\Psi(E_{0})\propto E_{0}^{-0.38}$ for the low-energy segment and $\Psi(E_{0})\propto E_{0}^{-2.01}$ for the high-energy segment with a dividing line of $\sim2.1\times10^{40} \rm erg$. Interestingly, we find that the formation rate of CHIME FRBs also evolves with redshift as $\rho(z)\propto(1+z)^{-4.73\pm0.08}$. The local formation rate $\rho(0)$ of the CHIME FRBs is constrained to be about $ 1.25\times 10^4\rm{\,Gpc^{-3}yr^{-1}}$ that is comparable with some previous estimations. In addition, we notice the formation rate not only exceeds the star formation rate at the lower redshifts but also always declines with the increase of redshift, which does not match the star formation history at all. Consequently, we suggest that most FRBs could originate from the older stellar populations.


title: Generative AI as Economic Agents

abstract: Traditionally, AI has been modeled within economics as a technology that impacts payoffs by reducing costs or refining information for human agents. Our position is that, in light of recent advances in generative AI, it is increasingly useful to model AI itself as an economic agent. In our framework, each user is augmented with an AI agent and can consult the AI prior to taking actions in a game. The AI agent and the user have potentially different information and preferences over the communication, which can result in equilibria that are qualitatively different than in settings without AI.


title: Green Supply Chain Management Optimization Based on Chemical Industrial Clusters

abstract: Post-pandemic, the chemical sector faces new challenges crucial to national progress, with a pressing need for rapid transformation and upgrading. The pandemic's impact and increasing demand for sustainability have highlighted the importance of green supply chain management. This study used a questionnaire survey and analyzed the data with SPSS and AMOS to investigate the influence of factors like regulatory compliance, green procurement, manufacturing, logistics, sales, competitors, internal environmental protection, and cost control on green supply chain management awareness and implementation in chemical enterprises. The results show that these factors significantly enhance green supply chain management, contributing to economic and environmental benefits. This paper provides a theoretical framework to improve green supply chain efficiency in chemical clusters, promoting sustainable industry growth.


title: End-to-End Model-based Deep Learning for Dual-Energy Computed Tomography Material Decomposition

abstract: Dual energy X-ray Computed Tomography (DECT) enables to automatically decompose materials in clinical images without the manual segmentation using the dependency of the X-ray linear attenuation with energy. In this work we propose a deep learning procedure called End-to-End Material Decomposition (E2E-DEcomp) for quantitative material decomposition which directly convert the CT projection data into material images. The algorithm is based on incorporating the knowledge of the spectral model DECT system into the deep learning training loss and combining a data-learned prior in the material image domain. Furthermore, the training does not require any energy-based images in the dataset but rather only sinogram and material images. We show the effectiveness of the proposed direct E2E-DEcomp method on the AAPM spectral CT dataset (Sidky and Pan, 2023) compared with state of the art supervised deep learning networks.


title: AlignSAM: Aligning Segment Anything Model to Open Context via Reinforcement Learning

abstract: Powered by massive curated training data, Segment Anything Model (SAM) has demonstrated its impressive generalization capabilities in open-world scenarios with the guidance of prompts. However, the vanilla SAM is class agnostic and heavily relies on user-provided prompts to segment objects of interest. Adapting this method to diverse tasks is crucial for accurate target identification and to avoid suboptimal segmentation results. In this paper, we propose a novel framework, termed AlignSAM, designed for automatic prompting for aligning SAM to an open context through reinforcement learning. Anchored by an agent, AlignSAM enables the generality of the SAM model across diverse downstream tasks while keeping its parameters frozen. Specifically, AlignSAM initiates a prompting agent to iteratively refine segmentation predictions by interacting with the foundational model. It integrates a reinforcement learning policy network to provide informative prompts to the foundational models. Additionally, a semantic recalibration module is introduced to provide fine-grained labels of prompts, enhancing the model's proficiency in handling tasks encompassing explicit and implicit semantics. Experiments conducted on various challenging segmentation tasks among existing foundation models demonstrate the superiority of the proposed AlignSAM over state-of-the-art approaches. Project page: \url{https://github.com/Duojun-Huang/AlignSAM-CVPR2024}.


title: Effectiveness of Vision Language Models for Open-world Single Image Test Time Adaptation

abstract: We propose a novel framework to address the real-world challenging task of Single Image Test Time Adaptation in an open and dynamic environment. We leverage large scale Vision Language Models like CLIP to enable real time adaptation on a per-image basis without access to source data or ground truth labels. Since the deployed model can also encounter unseen classes in an open world, we first employ a simple and effective Out of Distribution (OOD) detection module to distinguish between weak and strong OOD samples. We propose a novel contrastive learning based objective to enhance the discriminability between weak and strong OOD samples by utilizing small, dynamically updated feature banks. Finally, we also employ a classification objective for adapting the model using the reliable weak OOD samples. The proposed framework ROSITA combines these components, enabling continuous online adaptation of Vision Language Models on a single image basis. Extensive experimentation on diverse domain adaptation benchmarks validates the effectiveness of the proposed framework. Our code can be found at the project site https://manogna-s.github.io/rosita/


title: Comprehensive analysis of the Apertif Fast Radio Burst sample: similarities with young, energetic neutron stars

abstract: Understanding the origin of fast radio bursts (FRBs) has become the main science driver of recent dedicated FRB surveys. Between July 2019 and February 2022, we carried out ALERT, an FRB survey at 1370 MHz using the Apertif instrument installed at the Westerbork Synthesis Radio Telescope (WSRT). Here we report the detection of 18 new FRBs, and we study the properties of the entire 24 burst sample detected during the survey. For five bursts, we identify host galaxy candidates with >50% probability association. We observe an average linear polarisation fraction of $\sim$43% and an average circular polarisation fraction consistent with 0%. A third of the FRBs display multiple components. The sample next reveals a population of highly scattered bursts, which is most likely to have been produced in the immediate circumburst environment. Furthermore, two FRBs show evidence for high rotation measures, reaching |RM|>$10^3$ rad m$^{-2}$ in the source reference frames. Together, the scattering and rotation measures ALERT finds prove that a large fraction of FRBs are embedded in complex media such as star forming regions or supernova remnants. Through the discovery of the third most dispersed FRB so far, we show that one-off FRBs can emit at frequencies in excess of 6 GHz. Finally, we determine an FRB all-sky rate of $459^{+208}_{-155}$ sky$^{-1}$ day$^{-1}$ above a fluence limit of 4.1 Jy ms, and a fluence cumulative distribution with a power law index $\gamma=-1.23\pm0.06\pm0.2$, which is roughly consistent with the Euclidean Universe predictions. Through the high resolution in time, frequency, polarisation and localisation that ALERT featured, we were able to determine the morphological complexity, polarisation, local scattering and magnetic environment, and high-frequency luminosity of FRBs. We find all these strongly resemble those seen in young, energetic, highly magnetised neutron stars.


title: Exploring the limits of Hierarchical World Models in Reinforcement Learning

abstract: Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to solve complex tasks efficiently. While HMBRL has great potential, it still lacks wide adoption. In this work we describe a novel HMBRL framework and evaluate it thoroughly. To complement the multi-layered decision making idiom characteristic for HRL, we construct hierarchical world models that simulate environment dynamics at various levels of temporal abstraction. These models are used to train a stack of agents that communicate in a top-down manner by proposing goals to their subordinate agents. A significant focus of this study is the exploration of a static and environment agnostic temporal abstraction, which allows concurrent training of models and agents throughout the hierarchy. Unlike most goal-conditioned H(MB)RL approaches, it also leads to comparatively low dimensional abstract actions. Although our HMBRL approach did not outperform traditional methods in terms of final episode returns, it successfully facilitated decision making across two levels of abstraction using compact, low dimensional abstract actions. A central challenge in enhancing our method's performance, as uncovered through comprehensive experimentation, is model exploitation on the abstract level of our world model stack. We provide an in depth examination of this issue, discussing its implications for the field and suggesting directions for future research to overcome this challenge. By sharing these findings, we aim to contribute to the broader discourse on refining HMBRL methodologies and to assist in the development of more effective autonomous learning systems for complex decision-making environments.


title: Finite-temperature equations of state of compact stars with hyperons: three-dimensional tables

abstract: We construct tables of finite temperature equation of state (EoS) of hypernuclear matter in the range of densities, temperatures, and electron fractions that are needed for numerical simulations of supernovas, proto-neutron stars, and binary neutron star mergers and cast them in the format of {\sc CompOSE} database. The tables are extracted from a model that is based on covariant density functional (CDF) theory that includes the full $J^P=1/2^+$ baryon octet in a manner that is consistent with the current astrophysical and nuclear constraints. We employ a parameterization with three different values of the slope of the symmetry energy $L_{\rm sym}=30$, 50 and 70 MeV and fixed skewness $Q_{\rm sat}= 400$ MeV for above saturation matter. A model for the EoS of inhomogeneous matter is matched at sub-saturation density to the high-density hypernuclear EoS. We discuss the generic features of the resulting EoS and the composition of matter as a function of density, temperature, and electron fraction. The nuclear characteristics and strangeness fraction of these models are compared to the alternatives from the literature. The integral properties of static and rapidly rotating compact stars in the limit of zero temperature are discussed and confronted with the multimessenger astrophysical constraints.


title: TacShade A New 3D-printed Soft Optical Tactile Sensor Based on Light, Shadow and Greyscale for Shape Reconstruction

abstract: In this paper, we present the TacShade a newly designed 3D-printed soft optical tactile sensor. The sensor is developed for shape reconstruction under the inspiration of sketch drawing that uses the density of sketch lines to draw light and shadow, resulting in the creation of a 3D-view effect. TacShade, building upon the strengths of the TacTip, a single-camera tactile sensor of large in-depth deformation and being sensitive to edge and surface following, improves the structure in that the markers are distributed within the gap of papillae pins. Variations in light, dark, and grey effects can be generated inside the sensor through external contact interactions. The contours of the contacting objects are outlined by white markers, while the contact depth characteristics can be indirectly obtained from the distribution of black pins and white markers, creating a 2.5D visualization. Based on the imaging effect, we improve the Shape from Shading (SFS) algorithm to process tactile images, enabling a coarse but fast reconstruction for the contact objects. Two experiments are performed. The first verifies TacShade s ability to reconstruct the shape of the contact objects through one image for object distinction. The second experiment shows the shape reconstruction capability of TacShade for a large panel with ridged patterns based on the location of robots and image splicing technology.


title: Quantum Computing for Option Portfolio Analysis

abstract: In this paper, we introduce an efficient and end-to-end quantum algorithm tailored for computing the Value-at-Risk (VaR) and conditional Value-at-Risk (CVar) for a portfolio of European options. Our focus is on leveraging quantum computation to overcome the challenges posed by high dimensionality in VaR and CVaR estimation. While our innovative quantum algorithm is designed primarily for estimating portfolio VaR and CVaR for European options, we also investigate the feasibility of applying a similar quantum approach to price American options. Our analysis reveals a quantum 'no-go' theorem within the current algorithm, highlighting its limitation in pricing American options. Our results indicate the necessity of investigating alternative strategies to resolve the complementarity challenge in pricing American options in future research.


title: Optimistic Rates for Learning from Label Proportions

abstract: We consider a weakly supervised learning problem called Learning from Label Proportions (LLP), where examples are grouped into ``bags'' and only the average label within each bag is revealed to the learner. We study various learning rules for LLP that achieve PAC learning guarantees for classification loss. We establish that the classical Empirical Proportional Risk Minimization (EPRM) learning rule (Yu et al., 2014) achieves fast rates under realizability, but EPRM and similar proportion matching learning rules can fail in the agnostic setting. We also show that (1) a debiased proportional square loss, as well as (2) a recently proposed EasyLLP learning rule (Busa-Fekete et al., 2023) both achieve ``optimistic rates'' (Panchenko, 2002); in both the realizable and agnostic settings, their sample complexity is optimal (up to log factors) in terms of $\epsilon, \delta$, and VC dimension.


title: Federated Model Heterogeneous Matryoshka Representation Learning

abstract: Model heterogeneous federated learning (MHeteroFL) enables FL clients to collaboratively train models with heterogeneous structures in a distributed fashion. However, existing MHeteroFL methods rely on training loss to transfer knowledge between the client model and the server model, resulting in limited knowledge exchange. To address this limitation, we propose the Federated model heterogeneous Matryoshka Representation Learning (FedMRL) approach for supervised learning tasks. It adds an auxiliary small homogeneous model shared by clients with heterogeneous local models. (1) The generalized and personalized representations extracted by the two models' feature extractors are fused by a personalized lightweight representation projector. This step enables representation fusion to adapt to local data distribution. (2) The fused representation is then used to construct Matryoshka representations with multi-dimensional and multi-granular embedded representations learned by the global homogeneous model header and the local heterogeneous model header. This step facilitates multi-perspective representation learning and improves model learning capability. Theoretical analysis shows that FedMRL achieves a $O(1/T)$ non-convex convergence rate. Extensive experiments on benchmark datasets demonstrate its superior model accuracy with low communication and computational costs compared to seven state-of-the-art baselines. It achieves up to 8.48% and 24.94% accuracy improvement compared with the state-of-the-art and the best same-category baseline, respectively.


title: Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction

abstract: Sign stochastic gradient descent (signSGD) is a communication-efficient method that transmits only the sign of stochastic gradients for parameter updating. Existing literature has demonstrated that signSGD can achieve a convergence rate of $\mathcal{O}(d^{1/2}T^{-1/4})$, where $d$ represents the dimension and $T$ is the iteration number. In this paper, we improve this convergence rate to $\mathcal{O}(d^{1/2}T^{-1/3})$ by introducing the Sign-based Stochastic Variance Reduction (SSVR) method, which employs variance reduction estimators to track gradients and leverages their signs to update. For finite-sum problems, our method can be further enhanced to achieve a convergence rate of $\mathcal{O}(m^{1/4}d^{1/2}T^{-1/2})$, where $m$ denotes the number of component functions. Furthermore, we investigate the heterogeneous majority vote in distributed settings and introduce two novel algorithms that attain improved convergence rates of $\mathcal{O}(d^{1/2}T^{-1/2} + dn^{-1/2})$ and $\mathcal{O}(d^{1/4}T^{-1/4})$ respectively, outperforming the previous results of $\mathcal{O}(dT^{-1/4} + dn^{-1/2})$ and $\mathcal{O}(d^{3/8}T^{-1/8})$, where $n$ represents the number of nodes. Numerical experiments across different tasks validate the effectiveness of our proposed methods.


title: Research on the Application of Computer Vision Based on Deep Learning in Autonomous Driving Technology

abstract: This research aims to explore the application of deep learning in autonomous driving computer vision technology and its impact on improving system performance. By using advanced technologies such as convolutional neural networks (CNN), multi-task joint learning methods, and deep reinforcement learning, this article analyzes in detail the application of deep learning in image recognition, real-time target tracking and classification, environment perception and decision support, and path planning and navigation. Application process in key areas. Research results show that the proposed system has an accuracy of over 98% in image recognition, target tracking and classification, and also demonstrates efficient performance and practicality in environmental perception and decision support, path planning and navigation. The conclusion points out that deep learning technology can significantly improve the accuracy and real-time response capabilities of autonomous driving systems. Although there are still challenges in environmental perception and decision support, with the advancement of technology, it is expected to achieve wider applications and greater capabilities in the future. potential.


title: Optimizing Age of Information in Random Access Networks: A Second-Order Approach for Active/Passive Users

abstract: In this paper, we study the moments of the Age of Information (AoI) for both active and passive users in a random access network. In this network, active users broadcast sensing data, while passive users detect in-band radio activities from out-of-network devices, such as jammers. Collisions occur when multiple active users transmit simultaneously. Passive users can detect radio activities only when no active user transmits. Each active user's transmission behavior follows a Markov process. We aim to minimize the weighted sum of any moments of AoI for both user types. To achieve this, we employ a second-order analysis of system behavior. Specifically, we characterize an active user's transmission Markov process using its mean and temporal variance. We show that any moment of the AoI can be approximated by a function of these two parameters. This insight enables us to analyze and optimize the transmission Markov process for active users. We apply this strategy to two different random access models. Simulation results show that policies derived from this strategy outperform other baseline policies.


title: SAM-VMNet: Deep Neural Networks For Coronary Angiography Vessel Segmentation

abstract: Coronary artery disease (CAD) is one of the most prevalent diseases in the cardiovascular field and one of the major contributors to death worldwide. Computed Tomography Angiography (CTA) images are regarded as the authoritative standard for the diagnosis of coronary artery disease, and by performing vessel segmentation and stenosis detection on CTA images, physicians are able to diagnose coronary artery disease more accurately. In order to combine the advantages of both the base model and the domain-specific model, and to achieve high-precision and fully-automatic segmentation and detection with a limited number of training samples, we propose a novel architecture, SAM-VMNet, which combines the powerful feature extraction capability of MedSAM with the advantage of the linear complexity of the visual state-space model of VM-UNet, giving it faster inferences than Vision Transformer with faster inference speed and stronger data processing capability, achieving higher segmentation accuracy and stability for CTA images. Experimental results show that the SAM-VMNet architecture performs excellently in the CTA image segmentation task, with a segmentation accuracy of up to 98.32% and a sensitivity of up to 99.33%, which is significantly better than other existing models and has stronger domain adaptability. Comprehensive evaluation of the CTA image segmentation task shows that SAM-VMNet accurately extracts the vascular trunks and capillaries, demonstrating its great potential and wide range of application scenarios for the vascular segmentation task, and also laying a solid foundation for further stenosis detection.


title: Assessment of Case Influence in the Lasso with a Case-weight Adjusted Solution Path

abstract: We study case influence in the Lasso regression using Cook's distance which measures overall change in the fitted values when one observation is deleted. Unlike in ordinary least squares regression, the estimated coefficients in the Lasso do not have a closed form due to the nondifferentiability of the $\ell_1$ penalty, and neither does Cook's distance. To find the case-deleted Lasso solution without refitting the model, we approach it from the full data solution by introducing a weight parameter ranging from 1 to 0 and generating a solution path indexed by this parameter. We show that the solution path is piecewise linear with respect to a simple function of the weight parameter under a fixed penalty. The resulting case influence is a function of the penalty and weight, and it becomes Cook's distance when the weight is 0. As the penalty parameter changes, selected variables change, and the magnitude of Cook's distance for the same data point may vary with the subset of variables selected. In addition, we introduce a case influence graph to visualize how the contribution of each data point changes with the penalty parameter. From the graph, we can identify influential points at different penalty levels and make modeling decisions accordingly. Moreover, we find that case influence graphs exhibit different patterns between underfitting and overfitting phases, which can provide additional information for model selection.


title: Activation-Descent Regularization for Input Optimization of ReLU Networks

abstract: We present a new approach for input optimization of ReLU networks that explicitly takes into account the effect of changes in activation patterns. We analyze local optimization steps in both the input space and the space of activation patterns to propose methods with superior local descent properties. To accomplish this, we convert the discrete space of activation patterns into differentiable representations and propose regularization terms that improve each descent step. Our experiments demonstrate the effectiveness of the proposed input-optimization methods for improving the state-of-the-art in various areas, such as adversarial learning, generative modeling, and reinforcement learning.


title: Audio-Visual Talker Localization in Video for Spatial Sound Reproduction

abstract: Object-based audio production requires the positional metadata to be defined for each point-source object, including the key elements in the foreground of the sound scene. In many media production use cases, both cameras and microphones are employed to make recordings, and the human voice is often a key element. In this research, we detect and locate the active speaker in the video, facilitating the automatic extraction of the positional metadata of the talker relative to the camera's reference frame. With the integration of the visual modality, this study expands upon our previous investigation focused solely on audio-based active speaker detection and localization. Our experiments compare conventional audio-visual approaches for active speaker detection that leverage monaural audio, our previous audio-only method that leverages multichannel recordings from a microphone array, and a novel audio-visual approach integrating vision and multichannel audio. We found the role of the two modalities to complement each other. Multichannel audio, overcoming the problem of visual occlusions, provides a double-digit reduction in detection error compared to audio-visual methods with single-channel audio. The combination of multichannel audio and vision further enhances spatial accuracy, leading to a four-percentage point increase in F1 score on the Tragic Talkers dataset. Future investigations will assess the robustness of the model in noisy and highly reverberant environments, as well as tackle the problem of off-screen speakers.


title: Cyberwar Strategy and Tactics: An Analysis of Cyber Goals, Strategies, Tactics, and Techniques

abstract: Cyberwar strategy and tactics today are primitive and ad-hoc, resulting in an ineffective and reactive cyber fighting force. A Cyberwar Playbook is an encoding of knowledge on how to effectively handle a variety of cyberwar situations. It takes a troubleshooting approach and defines the cyber tactics, techniques and procedures one may employ to counter or avert cyber-based attacks. It provides focus and clarity in time of chaos allowing a clear path of response to be chosen.


title: Recent Advances in End-to-End Simultaneous Speech Translation

abstract: Simultaneous speech translation (SimulST) is a demanding task that involves generating translations in real-time while continuously processing speech input. This paper offers a comprehensive overview of the recent developments in SimulST research, focusing on four major challenges. Firstly, the complexities associated with processing lengthy and continuous speech streams pose significant hurdles. Secondly, satisfying real-time requirements presents inherent difficulties due to the need for immediate translation output. Thirdly, striking a balance between translation quality and latency constraints remains a critical challenge. Finally, the scarcity of annotated data adds another layer of complexity to the task. Through our exploration of these challenges and the proposed solutions, we aim to provide valuable insights into the current landscape of SimulST research and suggest promising directions for future exploration.


title: Capped Vertex Functions for $\text{Hilb}^n (\mathbb{C}^2)$

abstract: We obtain explicit formulas for capped descendent vertex functions of $\text{Hilb}^n(\mathbb{C}^2)$ for descendents given by chern classes of tautological bundles. The expression is the result of twisting a well known generating function for normalized Macdonald polynomials. This gives an explicit description of the rational function the capped vertex is an expansion of. Along the way we prove various limit expressions of the capping operator and the bare vertex function.

categories: math-ph hep-th math.AG math.CO math.MP math.RT


title: Conformal Transformation of Kernels: A Geometric Perspective on Text Classification

abstract: In this article we investigate the effects of conformal transformations on kernel functions used in Support Vector Machines. Our focus lies in the task of text document categorization, which involves assigning each document to a particular category. We introduce a new Gaussian Cosine kernel alongside two conformal transformations. Building upon previous studies that demonstrated the efficacy of conformal transformations in increasing class separability on synthetic and low-dimensional datasets, we extend this analysis to the high-dimensional domain of text data. Our experiments, conducted on the Reuters dataset on two types of binary classification tasks, compare the performance of Linear, Gaussian, and Gaussian Cosine kernels against their conformally transformed counterparts. The findings indicate that conformal transformations can significantly improve kernel performance, particularly for sub-optimal kernels. Specifically, improvements were observed in 60% of the tested scenarios for the Linear kernel, 84% for the Gaussian kernel, and 80% for the Gaussian Cosine kernel. In light of these findings, it becomes clear that conformal transformations play a pivotal role in enhancing kernel performance, offering substantial benefits.