title: Reinforcement learning with Demonstrations from Mismatched Task under Sparse Reward

abstract: Reinforcement learning often suffer from the sparse reward issue in real-world robotics problems. Learning from demonstration (LfD) is an effective way to eliminate this problem, which leverages collected expert data to aid online learning. Prior works often assume that the learning agent and the expert aim to accomplish the same task, which requires collecting new data for every new task. In this paper, we consider the case where the target task is mismatched from but similar with that of the expert. Such setting can be challenging and we found existing LfD methods can not effectively guide learning in mismatched new tasks with sparse rewards. We propose conservative reward shaping from demonstration (CRSfD), which shapes the sparse rewards using estimated expert value function. To accelerate learning processes, CRSfD guides the agent to conservatively explore around demonstrations. Experimental results of robot manipulation tasks show that our approach outperforms baseline LfD methods when transferring demonstrations collected in a single task to other different but similar tasks.


title: Open RAN Security: Challenges and Opportunities

abstract: Open RAN (ORAN, O-RAN) represents a novel industry-level standard for RAN (Radio Access Network), which defines interfaces that support inter-operation between vendors' equipment and offer network flexibility at a lower cost. Open RAN integrates the benefits and advancements of network softwarization and Artificial Intelligence to enhance the operation of RAN devices and operations. Open RAN offers new possibilities so that different stakeholders can develop the RAN solution in this open ecosystem. However, the benefits of Open RAN bring new security and privacy challenges. As Open RAN offers an entirely different RAN configuration than what exists today, it could lead to severe security and privacy issues if mismanaged, and stakeholders are understandably taking a cautious approach towards the security of Open RAN deployment. In particular, this paper provides a deep analysis of the security and privacy risks and challenges associated with Open RAN architecture. Then, it discusses possible security and privacy solutions to secure Open RAN architecture and presents relevant security standardization efforts relevant to Open RAN security. Finally, we discuss how Open RAN can be used to deploy more advanced security and privacy solutions in 5G and beyond RAN.


title: A Generalization of the Ishida Complex with applications

abstract: We construct a generalize Ishida complex to compute the local cohomology with monomial support of modules over quotients of polynomial rings by cellular binomial ideals. As a consequence, we obtain a combinatorial criterion to determine when such a quotient is Cohen--Macaulay. In particular, this gives a Cohen--Macaulayness criterion for lattice ideals. We also prove a result relating the local cohomology with radical monomial ideal support of an affine semigroup ring to the local cohomology with maximal ideal support of the quotient of the affine semigroup ring by the radical monomial ideal. This requires a combinatorial assumption on the semigroup, which holds for (not necessarily normal) semigroups whose cone is the cone over a simplex.


title: Cosmological Complexity from initial thermal state

abstract: The cosmological scalar perturbations should satisfy the thermal distribution at the beginning of inflation since the cosmic temperature is presumably very high. In this paper, we investigate, by the Fubini-study method, the effect of this thermal contribution, which is characterized by a parameter $\kappa_{0}$, on the evolution of the cosmological complexity $\mathcal{C}_{FS}$ . We find that when the thermal effect is considered, the Universe would ``decomplex" firstly with the cosmic expansion after the mode of the scalar perturbations exiting the horizon in the de Sitter (dS) phase and $\mathcal{C}_{FS}$ has a minimum about $\pi/4$. If $\mathcal{C}_{FS}$ can reach its minimum during the dS era, which requires a small $\kappa_0$ or a large e-folding number for a large $\kappa_0$, it will bounce back to increase, and after the Universe enters the radiation dominated (RD) phase from the dS one, $\mathcal{C}_{FS}$ will decrease, pass its minimum again, and then increase till the mode reenters the horizon. For the case of a large enough $\kappa_0$, $\mathcal{C}_{FS}$ decreases but does not reach its minimum during the dS era, and it begins to increase after the transition from the dS phase to the RD one. When the mode reenters the horizon during the RD era, the cosmological complexity will oscillate around about $\kappa_{0}$. These features are different from that of the initial zero-temperature case, i.e., the cosmological complexity increases during the dS phase and decreases in the RD era till the mode reenters the horizon. Our results therefore suggest that the thermal effect changes qualitatively the evolutionary behavior of the cosmological complexity.


title: Mind the gap: Achieving a super-Grover quantum speedup by jumping to the end

abstract: We present a quantum algorithm that has rigorous runtime guarantees for several families of binary optimization problems, including Quadratic Unconstrained Binary Optimization (QUBO), Ising spin glasses ($p$-spin model), and $k$-local constraint satisfaction problems ($k$-CSP). We show that either (a) the algorithm finds the optimal solution in time $O^*(2^{(0.5-c)n})$ for an $n$-independent constant $c$, a $2^{cn}$ advantage over Grover's algorithm; or (b) there are sufficiently many low-cost solutions such that classical random guessing produces a $(1-\eta)$ approximation to the optimal cost value in sub-exponential time for arbitrarily small choice of $\eta$. Additionally, we show that for a large fraction of random instances from the $k$-spin model and for any fully satisfiable or slightly frustrated $k$-CSP formula, statement (a) is the case. The algorithm and its analysis is largely inspired by Hastings' short-path algorithm [$\textit{Quantum}$ $\textbf{2}$ (2018) 78].


title: Search for pair production of the heavy vectorlike top partner in same-sign dilepton signature at the HL-LHC

abstract: New vectorlike quarks are predicted in many new physics scenarios beyond the Standard Model~(SM) and could potentially be discovered at the LHC. Based on a simplified model including a singlet vectorlike top partner with charge $2/3$, we investigate the process $pp \to TT$ via a $t$-channel induced by the couplings between the top partner with the first-generation SM quarks. We calculate the production cross section and further study the observability of the heavy top partner in the channel $T\to Wq$ at the high-luminosity LHC (HL-LHC) using final states with same-sign dileptons (electrons or muons), two jets, and missing transverse momentum. At the 14 TeV LHC with an integrated luminosity of 3000 fb$^{-1}$, the $2\sigma$ exclusion limits, as well as the $5\sigma$ discovery reach in the parameter plane of the two variables $g^{\ast}-R_L$, are respectively obtained at the HL-LHC. We also obtain the $2\sigma$ exclusion limit on the coupling strength parameter $g^{\ast}$ in the case in which the vectorlike top partner is coupled only to the first-generation quarks.


title: Orders Are Unwanted: Dynamic Deep Graph Convolutional Network for Personality Detection

abstract: Predicting personality traits based on online posts has emerged as an important task in many fields such as social network analysis. One of the challenges of this task is assembling information from various posts into an overall profile for each user. While many previous solutions simply concatenate the posts into a long document and then encode the document by sequential or hierarchical models, they introduce unwarranted orders for the posts, which may mislead the models. In this paper, we propose a dynamic deep graph convolutional network (D-DGCN) to overcome the above limitation. Specifically, we design a learn-to-connect approach that adopts a dynamic multi-hop structure instead of a deterministic structure, and combine it with a DGCN module to automatically learn the connections between posts. The modules of post encoder, learn-to-connect, and DGCN are jointly trained in an end-to-end manner. Experimental results on the Kaggle and Pandora datasets show the superior performance of D-DGCN to state-of-the-art baselines. Our code is available at https://github.com/djz233/D-DGCN.


title: Newtonian coalescence in colloidal and non-colloidal suspensions

abstract: Coalescence event in pendant and sessile drop is distinguished by the formation and evolution of the liquid bridge created upon singular contact. The bridge radius, $R$, is known to evolve as $R\sim t^b$, with power-law exponent, $b$, signifying the dominant governing forces. In this work, we experimentally explore the phenomenon in sub-classes of complex fluids namely, colloidal and non-colloidal suspensions that have particle hydrodynamic interactions as origin of viscoelasticity. Our observations suggest that such fluids have flow dependent thinning response with finite elasticity in shear flows but negligible in extensional flows. Based on these, the study extends the Newtonian universality of $b=0.5$ to these thinning fluids. Further we fortify these observations through a theoretical model developed by employing Ostwald-de Waele constitutive law. Finally, we utilize this theoretical model to inspect the existence of arrested coalescence in generalized Newtonian fluids.


title: The development of radioactivity measurement system in gases

abstract: A device for measuring radioactive impurities in gas is developed, consisting of an electrostatic collection type radon detector and an extremely low radioactivity proportional counter. This device measures the radioactive impurities released by materials into the gas and a filtering test for radon removal from gas. The performance of the newly developed proportional counter was evaluated by measuring radon rate. The calibration factor of $^{222}$Rn as 27.4$\pm$0.2~count/day/mBq and the background rate of $^{222}$Rn as 0.84$\pm$0.13~mBq were estimated.


title: Hedging Complexity in Generalization via a Parametric Distributionally Robust Optimization Framework

abstract: Empirical risk minimization (ERM) and distributionally robust optimization (DRO) are popular approaches for solving stochastic optimization problems that appear in operations management and machine learning. Existing generalization error bounds for these methods depend on either the complexity of the cost function or dimension of the random perturbations. Consequently, the performance of these methods can be poor for high-dimensional problems with complex objective functions. We propose a simple approach in which the distribution of random perturbations is approximated using a parametric family of distributions. This mitigates both sources of complexity; however, it introduces a model misspecification error. We show that this new source of error can be controlled by suitable DRO formulations. Our proposed parametric DRO approach has significantly improved generalization bounds over existing ERM and DRO methods and parametric ERM for a wide variety of settings. Our method is particularly effective under distribution shifts and works broadly in contextual optimization. We also illustrate the superior performance of our approach on both synthetic and real-data portfolio optimization and regression tasks.


title: Beyond ADMM: A Unified Client-variance-reduced Adaptive Federated Learning Framework

abstract: As a novel distributed learning paradigm, federated learning (FL) faces serious challenges in dealing with massive clients with heterogeneous data distribution and computation and communication resources. Various client-variance-reduction schemes and client sampling strategies have been respectively introduced to improve the robustness of FL. Among others, primal-dual algorithms such as the alternating direction of method multipliers (ADMM) have been found being resilient to data distribution and outperform most of the primal-only FL algorithms. However, the reason behind remains a mystery still. In this paper, we firstly reveal the fact that the federated ADMM is essentially a client-variance-reduced algorithm. While this explains the inherent robustness of federated ADMM, the vanilla version of it lacks the ability to be adaptive to the degree of client heterogeneity. Besides, the global model at the server under client sampling is biased which slows down the practical convergence. To go beyond ADMM, we propose a novel primal-dual FL algorithm, termed FedVRA, that allows one to adaptively control the variance-reduction level and biasness of the global model. In addition, FedVRA unifies several representative FL algorithms in the sense that they are either special instances of FedVRA or are close to it. Extensions of FedVRA to semi/un-supervised learning are also presented. Experiments based on (semi-)supervised image classification tasks demonstrate superiority of FedVRA over the existing schemes in learning scenarios with massive heterogeneous clients and client sampling.


title: Quantum Fluctuations of Fields and Stress Tensors

abstract: This is a review of recent work on quantum fluctuations of the electric field and of stress tensor operators and their physical effects. The probability distribution for vacuum fluctuations of the electric field is Gaussian, but that for quadratic operators, such as the energy density, can have a more slowly decreasing tail, leading to an enhanced probability of large fluctuations. This effect is very sensitive to the details of how the measurement is performed. Some possible physical effects of these large fluctuations will be discussed.


title: Distribution Fitting for Combating Mode Collapse in Generative Adversarial Networks

abstract: Mode collapse is a significant unsolved issue of generative adversarial networks. In this work, we examine the causes of mode collapse from a novel perspective. Due to the nonuniform sampling in the training process, some sub-distributions may be missed when sampling data. As a result, even when the generated distribution differs from the real one, the GAN objective can still achieve the minimum. To address the issue, we propose a global distribution fitting (GDF) method with a penalty term to confine the generated data distribution. When the generated distribution differs from the real one, GDF will make the objective harder to reach the minimal value, while the original global minimum is not changed. To deal with the circumstance when the overall real data is unreachable, we also propose a local distribution fitting (LDF) method. Experiments on several benchmarks demonstrate the effectiveness and competitive performance of GDF and LDF.


title: Evolution of dispersal in advective patchy environments

abstract: We study a two-species competition model in a patchy advective environment, where the species are subject to both directional drift and undirectional random dispersal between patches and there are losses of individuals in the downstream end (e.g., due to the flow into a lake or ocean). The two competing species are assumed to have the same growth rates but different advection and random dispersal rates. We focus our studies on the properties of an associated eigenvalue problem which characterizes the extinction/persistence dynamics of the underlying patch population model. We also derive conditions on the advection and random dispersal rates under which a mutating species can or cannot invade the resident species.


title: GlueFL: Reconciling Client Sampling and Model Masking for Bandwidth Efficient Federated Learning

abstract: Federated learning (FL) is an effective technique to directly involve edge devices in machine learning training while preserving client privacy. However, the substantial communication overhead of FL makes training challenging when edge devices have limited network bandwidth. Existing work to optimize FL bandwidth overlooks downstream transmission and does not account for FL client sampling. In this paper we propose GlueFL, a framework that incorporates new client sampling and model compression algorithms to mitigate low download bandwidths of FL clients. GlueFL prioritizes recently used clients and bounds the number of changed positions in compression masks in each round. Across three popular FL datasets and three state-of-the-art strategies, GlueFL reduces downstream client bandwidth by 27% on average and reduces training time by 29% on average.


title: Pandora's Problem with Nonobligatory Inspection: Optimal Structure and a PTAS

abstract: Weitzman introduced Pandora's box problem as a mathematical model of sequential search with inspection costs, in which a searcher is allowed to select a prize from one of $n$ alternatives. Several decades later, Doval introduced a close version of the problem, where the searcher does not need to incur the inspection cost of an alternative, and can select it uninspected. Unlike the original problem, the optimal solution to the nonobligatory inspection variant is proved to need adaptivity, and by recent work of [FLL22], finding the optimal solution is NP-hard. Our first main result is a structural characterization of the optimal policy: We show there exists an optimal policy that follows only two different pre-determined orders of inspection, and transitions from one to the other at most once. Our second main result is a polynomial time approximation scheme (PTAS). Our proof involves a novel reduction to a framework developed by [FLX18], utilizing our optimal two-phase structure. Furthermore, we show Pandora's problem with nonobligatory inspection belongs to class NP, which by using the hardness result of [FLL22], settles the computational complexity class of the problem. Finally, we provide a tight 0.8 approximation and a novel proof for committing policies [BK19] (informally, the set of nonadaptive policies) for general classes of distributions, which was previously shown only for discrete and finite distributions [GMS08].


title: On Tomaszewski's Cube Vertices Problem

abstract: The following assertion was equivalent to a conjecture proposed by B. Tomaszewski : Let $C$ be an $n$-dimensional unit cube and let $H$ be a plank of thickness $1$, both are centered at the origin, then no matter how to turn the cube around, $C\cap H$ contains at least half of the cube's $2^n$ vertices. A lower bound for the number of the vertices of $C$ in $C\cap H$ was obtained.


title: PHANGS-JWST First Results: The 21 $\mu$m Compact Source Population

abstract: We use PHANGS-JWST data to identify and classify 1271 compact 21 $\mu$m sources in four nearby galaxies using MIRI F2100W data. We identify sources using a dendrogram-based algorithm, and we measure the background-subtracted flux densities for JWST bands from 2 $\mu$m to 21 $\mu$m. Using the SED in JWST as well as HST bands, plus ALMA and MUSE/VLT observations, we classify the sources by eye. Then we use this classification to define regions in color-color space, and so establish a quantitative framework for classifying sources. We identify 1085 sources as belonging to the ISM of the target galaxies with the remainder being dusty stars or background galaxies. These 21 $\mu$m sources are strongly spatially associated with HII regions ($>92\%$ of sources), while 74$\%$ of sources are coincident with a stellar association defined in the HST data. Using SED fitting, we find that the stellar masses of the 21 $\mu$m sources span a range of 10$^{2}$ to 10$^{4}~M_\odot$ with mass-weighted ages down to 2 Myr. There is a tight correlation between attenuation-corrected H$\alpha$ and 21 $\mu$m luminosity for $L_{\nu,\mathrm{F2100W}}>10^{19}~\mathrm{W~Hz}^{-1}$. Young embedded source candidates selected at 21 $\mu$m are found below this threshold and have $M_\star < 10^{3}~M_\odot$.


title: Convergence of series of conditional expectations

abstract: This paper deals with rates of convergence in the strong law of large numbers, in the Baum-Katz form, for partial sums of Banach space valued random variables. The results are then applied to solve similar problems for weighted partial sums of conditional expectations. They are further used to treat partial sums of powers of a reversible Markov chain operator. The method of proof is based on martingale approximation. The conditions are expressed in terms moments of the individual summands.


title: IDMS: Instance Depth for Multi-scale Monocular 3D Object Detection

abstract: Due to the lack of depth information of images and poor detection accuracy in monocular 3D object detection, we proposed the instance depth for multi-scale monocular 3D object detection method. Firstly, to enhance the model's processing ability for different scale targets, a multi-scale perception module based on dilated convolution is designed, and the depth features containing multi-scale information are re-refined from both spatial and channel directions considering the inconsistency between feature maps of different scales. Firstly, we designed a multi-scale perception module based on dilated convolution to enhance the model's processing ability for different scale targets. The depth features containing multi-scale information are re-refined from spatial and channel directions considering the inconsistency between feature maps of different scales. Secondly, so as to make the model obtain better 3D perception, this paper proposed to use the instance depth information as an auxiliary learning task to enhance the spatial depth feature of the 3D target and use the sparse instance depth to supervise the auxiliary task. Finally, by verifying the proposed algorithm on the KITTI test set and evaluation set, the experimental results show that compared with the baseline method, the proposed method improves by 5.27\% in AP40 in the car category, effectively improving the detection performance of the monocular 3D object detection algorithm.


title: Laplacian Convolutional Representation for Traffic Time Series Imputation

abstract: Spatiotemporal traffic data imputation is of great significance in intelligent transportation systems and data-driven decision-making processes. To perform efficient learning and accurate reconstruction from partially observed traffic data, we assert the importance of characterizing both global and local trends in time series. In the literature, substantial works have demonstrated the effectiveness of utilizing the low-rank property of traffic data by matrix/tensor completion models. In this study, we first introduce a Laplacian kernel to temporal regularization for characterizing local trends in traffic time series, which can be formulated as a circular convolution. Then, we develop a low-rank Laplacian convolutional representation (LCR) model by putting the circulant matrix nuclear norm and the Laplacian kernelized temporal regularization together, which is proved to meet a unified framework that has a fast Fourier transform (FFT) solution in log-linear time complexity. Through extensive experiments on several traffic datasets, we demonstrate the superiority of LCR over several baseline models for imputing traffic time series of various time series behaviors (e.g., data noises and strong/weak periodicity) and reconstructing sparse speed fields of vehicular traffic flow. The proposed LCR model is also an efficient solution to large-scale traffic data imputation over the existing imputation models.


title: Nonlocal Mean Curvature with Integrable Kernel

abstract: We study the prescribed constant mean curvature problem in the nonlocal setting where the nonlocal curvature has been defined as $$ H^J_{\Omega}(x):=\int_{\mathbb{R} ^n} J(x-y)(\chi_{\Omega^c}(y)-\chi_{\Omega}(y))dy, $$ where $x \in \mathbb{R}^n$, $\Omega \subset \mathbb{R}^n$, $\chi$ is the characteristic function for a set, $J$ is a radially symmetric, nonegative, nonincreasing convolution kernel. Several papers have studied the case of nonlocal curvature with nonintegrable singularity, a generalization of the classical curvature concept, which requires the regularity of the boundary to be above $C^2$. Nonlocal curvature of this form appears in many different applications, such as image processing, curvature driven motion, deformations. In this work, we focus on the problem of constant nonlocal curvature defined via integrable kernel. Our results offer some extensions to the constant mean curvature problem for nonintegrable kernels, where counterparts to Alexandrov theorem in the nonlocal framework were established independently by two separate groups. Ciraolo, Figalli, Maggi, Novaga, and respectively, Cabr\'e, Fall, Sol\`a-Morales, Weth. Using the nonlocal Alexandrov's theorem we identify surfaces of constant mean nonlocal curvature for different integrable kernels as unions of balls situated at distance $\delta$ apart, where $\delta$ measures the radius of nonlocal interactions.


title: Unique ergodicity for singular holomorphic foliations of $\mathbb{P}^3(\mathbb{C})$ with an invariant plane

abstract: We prove a unique ergodicity theorem for singular holomorphic foliations of $\mathbb{P}^3(\mathbb{C})$ with hyperbolic singularities and with an invariant plane with no foliation cycle, in analogy with a result of Dinh-Sibony concerning unique ergodicity for foliations of $\mathbb{P}^2(\mathbb{C})$ with an invariant line. The proof is dynamical in nature and adapts the work of Deroin-Kleptsyn to a singular context, using the fundamental integrability estimate of Nguy\^en.


title: Algorithms and radiation dynamics for the vicinity of black holes I. Methods and codes

abstract: We examine radiation and its effects on accretion disks orbiting astrophysical black holes. These disks are thermally radiating and can be geometrically and optically thin or thick. In this first paper of the series, we discuss the physics and the formulation required for this study. Subsequently, we construct and solve the relativistic radiative transfer equation, or find suitable solutions where that is not possible. We continue by presenting some of the accretion disks we considered for this work. We then describe the families of codes developed in order to study particle trajectories in strong gravity, calculate radiation forces exerted onto the disk material, and generate observation pictures of black hole systems at infinity. Furthermore, we also examine the veracity and accuracy of our work. Finally, we investigate how we can further use our results to estimate the black hole spin and the motion of disk material subjected to these radiation forces.


title: Bounds on Choquet Risk Measures in Finite Product Spaces with Ambiguous Marginals

abstract: We investigate the problem of finding upper and lower bounds for a Choquet risk measure of a nonlinear function of two risk factors, when the marginal distributions of the risk factors are ambiguous and represented by nonadditive measures on the marginal spaces and the joint nonadditive distribution on the product space is unknown. We treat this problem as a generalization of the optimal transport problem to the setting of nonadditive measures. We provide explicit characterizations of the optimal solutions for finite marginal spaces, and we investigate some of their properties. We further discuss the connections with linear programming, showing that the optimal transport problems for capacities are linear programs, and we also characterize their duals explicitly. Finally, we investigate a series of numerical examples, including a comparison with the classical optimal transport problem, and applications to counterparty credit risk.


title: Partially coherent double phase holography in visible using meta-optics

abstract: Ultrathin flat meta-optics have shown great promise for holography in recent years. However, most of the reported meta-optical holograms rely on only phase modulation and neglect the amplitude information. Modulation of both amplitude and phase in meta-optics either requires polarization sensitive meta-atoms, or complex scatterers with stringent fabrication requirements. Additionally, almost all the meta-optical holograms were measured under laser illumination. Here we adopt the concept of double-phase holography, to report polarization-independent holography with both amplitude and phase modulation, using dielectric meta-optics. We validate the implementation of complex phase hologram by measuring an improvement of structural similarity of the reconstructed hologram by ~3x over phase-only holograms. Finally, we demonstrate that meta-optical holography can also be realized using partially incoherent light from a light emitting diode. This observation can significantly reduce the alignment complexity and speckles in laser-based meta-optical holography.


title: Prototype matching: children's preference for forming scientific concepts

abstract: Inspired by a sample lesson, this paper studies and discusses children's preferences in learning scientific concepts. In a "Dissolution" lesson, one of the students took the demonstration experiment of "carmine dissolves in Water" demonstrated by the teacher as the prototype to judge whether a new phenomenon belongs to dissolution, instead of analyzing and judging the phenomenon by using the dissolution definition. Therefore, we propose a conjecture that "prototype matching" may be a more preferred way for children to learn concepts than thinking through inquiry experiment, analysis, deduction, etc. To this end, we conducted a targeted test on 160 fifth grade students (all of whom had learned this lesson) from a primary school in Beijing, and used goodness of fit test to statistically analyze the results. The results showed that: 1. the Chi square of the general result is 73.865, P<0.001, indicating that children did have obvious prototype preference; 2. We "tampered" some of the prototypes, that is, they looked like the prototypes that the teacher had told students, but they were actually wrong. However, the results showed that children still preferred these so-called "prototypes" (chi square is 21.823, P<0.001). Conclusion: 1. Children have an obvious preference for "prototype matching" in scientific concept learning, which is not only obviously deviated from the current general understanding of science education that emphasizes discovery/inquiry construction, but also points out that there may be a priority relationship among various ways of concept organization (such as definition theory, prototype theory, schema theory, etc.). 2. Children's preference for prototypes seems to be unthinking, and they will not identify the authenticity of prototypes, which is particularly noteworthy in front-line teaching.


title: NEPTUNE: Nonentangling Trajectory Planning for Multiple Tethered Unmanned Vehicles

abstract: Despite recent progress on trajectory planning of multiple robots and path planning of a single tethered robot, planning of multiple tethered robots to reach their individual targets without entanglements remains a challenging problem. In this paper, we present a complete approach to address this problem. Firstly, we propose a multi-robot tether-aware representation of homotopy, using which we can efficiently evaluate the feasibility and safety of a potential path in terms of (1) the cable length required to reach a target following the path, and (2) the risk of entanglements with the cables of other robots. Then, the proposed representation is applied in a decentralized and online planning framework that includes a graph-based kinodynamic trajectory finder and an optimization-based trajectory refinement, to generate entanglement-free, collision-free and dynamically feasible trajectories. The efficiency of the proposed homotopy representation is compared against existing single and multiple tethered robot planning approaches. Simulations with up to 8 UAVs show the effectiveness of the approach in entanglement prevention and its real-time capabilities. Flight experiments using 3 tethered UAVs verify the practicality of the presented approach.


title: Efficiency Boosting of Secure Cross-platform Recommender Systems over Sparse Data

abstract: Fueled by its successful commercialization, the recommender system (RS) has gained widespread attention. However, as the training data fed into the RS models are often highly sensitive, it ultimately leads to severe privacy concerns, especially when data are shared among different platforms. In this paper, we follow the tune of existing works to investigate the problem of secure sparse matrix multiplication for cross-platform RSs. Two fundamental while critical issues are addressed: preserving the training data privacy and breaking the data silo problem. Specifically, we propose two concrete constructions with significantly boosted efficiency. They are designed for the sparse location insensitive case and location sensitive case, respectively. State-of-the-art cryptography building blocks including homomorphic encryption (HE) and private information retrieval (PIR) are fused into our protocols with non-trivial optimizations. As a result, our schemes can enjoy the HE acceleration technique without privacy trade-offs. We give formal security proofs for the proposed schemes and conduct extensive experiments on both real and large-scale simulated datasets. Compared with state-of-the-art works, our two schemes compress the running time roughly by 10* and 2.8*. They also attain up to 15* and 2.3* communication reduction without accuracy loss.


title: Multi-resolution Monocular Depth Map Fusion by Self-supervised Gradient-based Composition

abstract: Monocular depth estimation is a challenging problem on which deep neural networks have demonstrated great potential. However, depth maps predicted by existing deep models usually lack fine-grained details due to the convolution operations and the down-samplings in networks. We find that increasing input resolution is helpful to preserve more local details while the estimation at low resolution is more accurate globally. Therefore, we propose a novel depth map fusion module to combine the advantages of estimations with multi-resolution inputs. Instead of merging the low- and high-resolution estimations equally, we adopt the core idea of Poisson fusion, trying to implant the gradient domain of high-resolution depth into the low-resolution depth. While classic Poisson fusion requires a fusion mask as supervision, we propose a self-supervised framework based on guided image filtering. We demonstrate that this gradient-based composition performs much better at noisy immunity, compared with the state-of-the-art depth map fusion method. Our lightweight depth fusion is one-shot and runs in real-time, making our method 80X faster than a state-of-the-art depth fusion method. Quantitative evaluations demonstrate that the proposed method can be integrated into many fully convolutional monocular depth estimation backbones with a significant performance boost, leading to state-of-the-art results of detail enhancement on depth maps.


title: Exploring the Limits of Differentially Private Deep Learning with Group-wise Clipping

abstract: Differentially private deep learning has recently witnessed advances in computational efficiency and privacy-utility trade-off. We explore whether further improvements along the two axes are possible and provide affirmative answers leveraging two instantiations of \emph{group-wise clipping}. To reduce the compute time overhead of private learning, we show that \emph{per-layer clipping}, where the gradient of each neural network layer is clipped separately, allows clipping to be performed in conjunction with backpropagation in differentially private optimization. This results in private learning that is as memory-efficient and almost as fast per training update as non-private learning for many workflows of interest. While per-layer clipping with constant thresholds tends to underperform standard flat clipping, per-layer clipping with adaptive thresholds matches or outperforms flat clipping under given training epoch constraints, hence attaining similar or better task performance within less wall time. To explore the limits of scaling (pretrained) models in differentially private deep learning, we privately fine-tune the 175 billion-parameter GPT-3. We bypass scaling challenges associated with clipping gradients that are distributed across multiple devices with \emph{per-device clipping} that clips the gradient of each model piece separately on its host device. Privately fine-tuning GPT-3 with per-device clipping achieves a task performance at $\epsilon=1$ better than what is attainable by non-privately fine-tuning the largest GPT-2 on a summarization task.


title: Quadcopter Tracking Using Euler-Angle-Free Flatness-Based Control

abstract: Quadcopter trajectory tracking control has been extensively investigated and implemented in the past. Available controls mostly use the Euler angle standards to describe the quadcopters rotational kinematics and dynamics. As a result, the same rotation can be translated into different roll, pitch, and yaw angles because there are multiple Euler angle standards for characterization of rotation in a 3-dimensional motion space. Additionally, it is computationally expensive to convert a quadcopters orientation to the associated roll, pitch, and yaw angles, which may make it difficult to track quick and aggressive trajectories. To address these issues, this paper will develop a flatness-based trajectory tracking control without using Euler angles. We assess and test the proposed controls performance in the Gazebo simulation environment and contrast its functionality with the existing Mellinger controller, which has been widely adopted by the robotics and unmanned aerial system (UAS) communities.


title: Examples of non-Dini domains with large singular sets

abstract: Let $u$ be a non-trivial harmonic function in a domain $D\subset \mathbb{R}^d$ which vanishes on an open set of the boundary. In a recent paper, we showed that if $D$ is a $C^1$-Dini domain, then within the open set the singular set of $u$, defined as $\{X\in \overline{D}: u(X) = 0 = |\nabla u(X)|\} $, has finite $(d-2)$-dimensional Hausdorff measure. In this paper, we show that the assumption of $C^1$-Dini domains is sharp, by constructing a large class of non-Dini (but almost Dini) domains whose \textit{singular sets} have infinite $\mathcal{H}^{d-2}$-measures.


title: Detection of brain activations induced by naturalistic stimuli in a pseudo model-driven way

abstract: Naturalistic fMRI has been suggested to be a powerful alternative for investigations of human brain function. Stimulus-induced activation has been playing an essential role in fMRI-based brain function analyses. Due to the complexity of the stimuli, however, detection of activations induced by naturalistic stimuli (AINSs) has been a tricky problem, as AINS cannot be detected simply in a model-driven way. In this study, we proposed a method to detect AINS in a pseudo model-driven way. Inspired by the strategy of utilizing the commonalities among the brains exposed to the same stimuli for inter-subject correlation analysis, we established response models for one subject by averaging the fMRI signals across several other subjects, and then detected AINSs of the subject using general linear model. We evaluated the effectiveness of AINS with both statistical and predictive analyses on individual differences in sex and intelligence quotient (IQ), based on the four movie fMRI runs included in the Human Connectome Project dataset. The results indicate that AINS is not only sensitive to sex- and IQ-related differences, but also specific enough to decode individuals' sex and IQ. Specifically, activations in brain regions associated with visual-spatial processing were observed to be consistently stronger in the males, and individuals with higher IQ exhibited consistently stronger activations in regions within the visual and the default mode networks. Predictions of individuals' sex and IQ were significantly better than those based on random labels (P < 0.005). Taken together, AINS advanced in this study can be an effective evaluation of human brain function. The conceptual simplicity and easy application of its detection may make AINS a favorable choice for future brain function analyses and personalized medicine based on naturalistic fMRI.


title: The RoyalFlush System for the WMT 2022 Efficiency Task

abstract: This paper describes the submission of the RoyalFlush neural machine translation system for the WMT 2022 translation efficiency task. Unlike the commonly used autoregressive translation system, we adopted a two-stage translation paradigm called Hybrid Regression Translation (HRT) to combine the advantages of autoregressive and non-autoregressive translation. Specifically, HRT first autoregressively generates a discontinuous sequence (e.g., make a prediction every $k$ tokens, $k>1$) and then fills in all previously skipped tokens at once in a non-autoregressive manner. Thus, we can easily trade off the translation quality and speed by adjusting $k$. In addition, by integrating other modeling techniques (e.g., sequence-level knowledge distillation and deep-encoder-shallow-decoder layer allocation strategy) and a mass of engineering efforts, HRT improves 80\% inference speed and achieves equivalent translation performance with the same-capacity AT counterpart. Our fastest system reaches 6k+ words/second on the GPU latency setting, estimated to be about 3.1x faster than the last year's winner.


title: Probabilistic Verification of ReLU Neural Networks via Characteristic Functions

abstract: Verifying the input-output relationships of a neural network so as to achieve some desired performance specification is a difficult, yet important, problem due to the growing ubiquity of neural nets in many engineering applications. We use ideas from probability theory in the frequency domain to provide probabilistic verification guarantees for ReLU neural networks. Specifically, we interpret a (deep) feedforward neural network as a discrete dynamical system over a finite horizon that shapes distributions of initial states, and use characteristic functions to propagate the distribution of the input data through the network. Using the inverse Fourier transform, we obtain the corresponding cumulative distribution function of the output set, which can be used to check if the network is performing as expected given any random point from the input set. The proposed approach does not require distributions to have well-defined moments or moment generating functions. We demonstrate our proposed approach on two examples, and compare its performance to related approaches.


title: A Generalized Scalarization Method for Evolutionary Multi-Objective Optimization

abstract: The decomposition-based multi-objective evolutionary algorithm (MOEA/D) transforms a multi-objective optimization problem (MOP) into a set of single-objective subproblems for collaborative optimization. Mismatches between subproblems and solutions can lead to severe performance degradation of MOEA/D. Most existing mismatch coping strategies only work when the $L_{\infty}$ scalarization is used. A mismatch coping strategy that can use any $L_{p}$ scalarization, even when facing MOPs with non-convex Pareto fronts, is of great significance for MOEA/D. This paper uses the global replacement (GR) as the backbone. We analyze how GR can no longer avoid mismatches when $L_{\infty}$ is replaced by another $L_{p}$ with $p\in [1,\infty)$, and find that the $L_p$-based ($1\leq p<\infty$) subproblems having inconsistently large preference regions. When $p$ is set to a small value, some middle subproblems have very small preference regions so that their direction vectors cannot pass through their corresponding preference regions. Therefore, we propose a generalized $L_p$ (G$L_p$) scalarization to ensure that the subproblem's direction vector passes through its preference region. Our theoretical analysis shows that GR can always avoid mismatches when using the G$L_p$ scalarization for any $p\geq 1$. The experimental studies on various MOPs conform to the theoretical analysis.


title: UniSyn: An End-to-End Unified Model for Text-to-Speech and Singing Voice Synthesis

abstract: Text-to-speech (TTS) and singing voice synthesis (SVS) aim at generating high-quality speaking and singing voice according to textual input and music scores, respectively. Unifying TTS and SVS into a single system is crucial to the applications requiring both of them. Existing methods usually suffer from some limitations, which rely on either both singing and speaking data from the same person or cascaded models of multiple tasks. To address these problems, a simplified elegant framework for TTS and SVS, named UniSyn, is proposed in this paper. It is an end-to-end unified model that can make a voice speak and sing with only singing or speaking data from this person. To be specific, a multi-conditional variational autoencoder (MC-VAE), which constructs two independent latent sub-spaces with the speaker- and style-related (i.e. speak or sing) conditions for flexible control, is proposed in UniSyn. Moreover, supervised guided-VAE and timbre perturbation with the Wasserstein distance constraint are leveraged to further disentangle the speaker timbre and style. Experiments conducted on two speakers and two singers demonstrate that UniSyn can generate natural speaking and singing voice without corresponding training data. The proposed approach outperforms the state-of-the-art end-to-end voice generation work, which proves the effectiveness and advantages of UniSyn.


title: Radio continuum and OH line emission of high-z OH megamaser galaxies

abstract: We present the study of arcsecond scale radio continuum and OH line emission of a sample of known OH megamaser galaxies with $z \geq$ 0.15 using archival Very Large Array (VLA) data. And also the results of our pilot Five hundred meter aperture spherical radio telescope (FAST) observations of 12 of these OHM galaxies. The arcsecond-scale resolution images show that the OH emission is distributed in one compact structure and spatially associated with radio continuum emission. Furthermore, nearly all the fitted components are likely smaller than the beam size ($\sim$ 1.4"), which indicates that the broad OH line profiles of these sources originated from one masing region or that more components are distributed in sub-arcsec scales. The radio parameters, including brightness temperature, spectral index, and q-index, show no significant differences with the low-redshift OHM galaxies, which have significantly lower OH line luminosities. Because these parameters are indicators of the central power sources (AGN, starburst, or both), our results indicate that the presence of radio AGN in the nuclei may not be essential for the formation of OH emission. Over 1/3 of OHMs in this sample (6/17) show possible variable features likely caused by interstellar scintillation due to small angular sizes. We might underestimate this value because these sources are associated with this sample's highest OH line flux densities. Those with low OH line flux densities might need higher sensitivity observations to study the variabilities. These results support the compact nature of OH maser emission and a starburst origin for the OHMs in our selected sample.


title: FedRolex: Model-Heterogeneous Federated Learning with Rolling Sub-Model Extraction

abstract: Most cross-device federated learning (FL) studies focus on the model-homogeneous setting where the global server model and local client models are identical. However, such constraint not only excludes low-end clients who would otherwise make unique contributions to model training but also restrains clients from training large models due to on-device resource bottlenecks. In this work, we propose FedRolex, a partial training (PT)-based approach that enables model-heterogeneous FL and can train a global server model larger than the largest client model. At its core, FedRolex employs a rolling sub-model extraction scheme that allows different parts of the global server model to be evenly trained, which mitigates the client drift induced by the inconsistency between individual client models and server model architectures. We show that FedRolex outperforms state-of-the-art PT-based model-heterogeneous FL methods (e.g. Federated Dropout) and reduces the gap between model-heterogeneous and model-homogeneous FL, especially under the large-model large-dataset regime. In addition, we provide theoretical statistical analysis on its advantage over Federated Dropout and evaluate FedRolex on an emulated real-world device distribution to show that FedRolex can enhance the inclusiveness of FL and boost the performance of low-end devices that would otherwise not benefit from FL. Our code is available at: https://github.com/AIoT-MLSys-Lab/FedRolex


title: Eigenvalue spectral properties of sparse random matrices obeying Dale's law

abstract: This paper examines the relationship between sparse random network architectures and neural network stability by examining the eigenvalue spectral distribution. Specifically, we generalise classical eigenspectral results to sparse connectivity matrices obeying Dale's law: neurons function as either excitatory (E) or inhibitory (I). By defining sparsity as the probability that a neutron is connected to another neutron, we give explicit formulae that shows how sparsity interacts with the E/I population statistics to scale key features of the eigenspectrum, in both the balanced and unbalanced cases. Our results show that the eigenspectral outlier is linearly scaled by sparsity, but the eigenspectral radius and density now depend on a nonlinear interaction between sparsity, the E/I population means and variances. Contrary to previous results, we demonstrate that a non-uniform eigenspectral density results if any of the E/I population statistics differ, not just the E/I population variances. We also find that 'local' eigenvalue-outliers are present for sparse random matrices obeying Dale's law, and demonstrate that these eigenvalues can be controlled by a modified zero row-sum constraint for the balanced case, however, they persist in the unbalanced case. We examine all levels of connection (sparsity), and distributed E/I population weights, to describe a general class of sparse connectivity structures which unifies all the previous results as special cases of our framework. Sparsity and Dale's law are both fundamental anatomical properties of biological neural networks. We generalise their combined effects on the eigenspectrum of random neural networks, thereby gaining insight into network stability, state transitions and the structure-function relationship.


title: Quantum computation on a 19-qubit wide 2d nearest neighbour qubit array

abstract: In this paper, we explore the relationship between the width of a qubit lattice constrained in one dimension and physical thresholds for scalable, fault-tolerant quantum computation. To circumvent the traditionally low thresholds of small fixed-width arrays, we deliberately engineer an error bias at the lowest level of encoding using the surface code. We then address this engineered bias at a higher level of encoding using a lattice-surgery surface code bus that exploits this bias, or a repetition code to make logical qubits with unbiased errors out of biased surface code qubits. Arbitrarily low error rates can then be reached by further concatenating with other codes, such as Steane [[7,1,3]] code and the [[15,7,3]] CSS code. This enables a scalable fixed-width quantum computing architecture on a square qubit lattice that is only 19 qubits wide, given physical qubits with an error rate of $8.0\times 10^{-4}$. This potentially eases engineering issues in systems with fine qubit pitches, such as quantum dots in silicon or gallium arsenide.


title: Quantify the Causes of Causal Emergence: Critical Conditions of Uncertainty and Asymmetry in Causal Structure

abstract: Beneficial to advanced computing devices, models with massive parameters are increasingly employed to extract more information to enhance the precision in describing and predicting the patterns of objective systems. This phenomenon is particularly pronounced in research domains associated with deep learning. However, investigations of causal relationships based on statistical and informational theories have posed an interesting and valuable challenge to large-scale models in the recent decade. Macroscopic models with fewer parameters can outperform their microscopic counterparts with more parameters in effectively representing the system. This valuable situation is called "Causal Emergence." This paper introduces a quantification framework, according to the Effective Information and Transition Probability Matrix, for assessing numerical conditions of Causal Emergence as theoretical constraints of its occurrence. Specifically, our results quantitatively prove the cause of Causal Emergence. By a particular coarse-graining strategy, optimizing uncertainty and asymmetry within the model's causal structure is significantly more influential than losing maximum information due to variations in model scales. Moreover, by delving into the potential exhibited by Partial Information Decomposition and Deep Learning networks in the study of Causal Emergence, we discuss potential application scenarios where our quantification framework could play a role in future investigations of Causal Emergence.


title: Meta Learning for Few-Shot Medical Text Classification

abstract: Medical professionals frequently work in a data constrained setting to provide insights across a unique demographic. A few medical observations, for instance, informs the diagnosis and treatment of a patient. This suggests a unique setting for meta-learning, a method to learn models quickly on new tasks, to provide insights unattainable by other methods. We investigate the use of meta-learning and robustness techniques on a broad corpus of benchmark text and medical data. To do this, we developed new data pipelines, combined language models with meta-learning approaches, and extended existing meta-learning algorithms to minimize worst case loss. We find that meta-learning on text is a suitable framework for text-based data, providing better data efficiency and comparable performance to few-shot language models and can be successfully applied to medical note data. Furthermore, meta-learning models coupled with DRO can improve worst case loss across disease codes.


title: Short-term shock, long-lasting payment: Evidence from the Lushan Earthquake

abstract: Abrupt catastrophic events bring business risks into firms. The paper introduces the Great Lushan Earthquake in 2013 in China as an unexpected shock to explore the causal effects on public firms in both the long and short term. DID-PSM methods are conducted to examine the robustness of causal inference. The identifications and estimations indicate that catastrophic shock significantly negatively impacts cash flow liquidity and profitability in the short term. Besides, the practical influences on firms' manufacturing and operation emerge in the treated group. Firms increase non-business expenditures and retained earnings as a financial measure to resist series risk during the shock period. As the long-term payment, the decline in production factors, particularly in employment level and the loss in fixed assets, are permanent. The earthquake's comprehensive interactions are also reflected. The recovery from the disaster would benefit the companies by raising the growth rate of R\&D and enhancing competitiveness through increasing market share, though these effects are temporary. PSM-DID and event study methods are implemented to investigate the general effects of specific strong earthquakes on local public firms nationwide. Consistent with the Lushan Earthquake, the ratio of cash flow to sales dropped drastically and recovered in 3 subsequent semesters. The shock on sales was transitory, only in the current semester.


title: Distributionally Robust Lyapunov Function Search Under Uncertainty

abstract: This paper develops methods for proving Lyapunov stability of dynamical systems subject to disturbances with an unknown distribution. We assume only a finite set of disturbance samples is available and that the true online disturbance realization may be drawn from a different distribution than the given samples. We formulate an optimization problem to search for a sum-of-squares (SOS) Lyapunov function and introduce a distributionally robust version of the Lyapunov function derivative constraint. We show that this constraint may be reformulated as several SOS constraints, ensuring that the search for a Lyapunov function remains in the class of SOS polynomial optimization problems. For general systems, we provide a distributionally robust chance-constrained formulation for neural network Lyapunov function search. Simulations demonstrate the validity and efficiency of either formulation on non-linear uncertain dynamical systems.


title: Contrastive Domain Adaptation for Time-Series via Temporal Mixup

abstract: Unsupervised Domain Adaptation (UDA) has emerged as a powerful solution for the domain shift problem via transferring the knowledge from a labeled source domain to a shifted unlabeled target domain. Despite the prevalence of UDA for visual applications, it remains relatively less explored for time-series applications. In this work, we propose a novel lightweight contrastive domain adaptation framework called CoTMix for time-series data. Unlike existing approaches that either use statistical distances or adversarial techniques, we leverage contrastive learning solely to mitigate the distribution shift across the different domains. Specifically, we propose a novel temporal mixup strategy to generate two intermediate augmented views for the source and target domains. Subsequently, we leverage contrastive learning to maximize the similarity between each domain and its corresponding augmented view. The generated views consider the temporal dynamics of time-series data during the adaptation process while inheriting the semantics among the two domains. Hence, we gradually push both domains towards a common intermediate space, mitigating the distribution shift across them. Extensive experiments conducted on five real-world time-series datasets show that our approach can significantly outperform all state-of-the-art UDA methods. The implementation code of CoTMix is available at \href{https://github.com/emadeldeen24/CoTMix}{github.com/emadeldeen24/CoTMix}.


title: A correct proof of logarithmic coefficients for Janowski type $(j,k)$-symmetric starlike functions

abstract: Recently, authors [7] studied the logarithmic coefficient bounds for class of the Janowski type $(j,k)$-symmetric starlike functions $\mathcal{ST}_{[j,k]}(A,B)$ in ({\em Rev. Real Acad. Cienc. Exactas Fis. Nat. Ser. A-Mat.} (2022). DOI: 10.1007/s13398-022-01310-9). We pointed out that the proof of Theorem~3 in [7] is incorrect. In this article, we present the correct proof of Theorem~3. In addition, we also obtain some new results related to the logarithmic coefficient inequalities for the class $\mathcal{ST}_{[j,k]}(A,B)$.


title: Compacter networks as a defensive mechanism: How firms clustered during 2015 Financial Crisis in China

abstract: The stock market's reaction to the external risk shock is closely related to the cross-shareholding network structure. This paper takes the public information of listed companies in the A-share securities market as the primary sample to study the relationship between the stock return rate, market performance, and network topology before and after China's stock market crash in 2015. Data visualization and empirical analysis demonstrate that the return rate of stocks is related to the company's traditional business ability and the social capital brought by cross-holding. Several heteroscedasticity tests and endogeneity tests with IV are conducted to support the robustness. The structure of the cross-shareholding network experienced upheaval after the shock, even distorting the effects of market value, and assets holding on the return rate. The enterprises in the entire shareholding network are connected more firmly to overcome systematic external risks. The number of enterprise clusters is significantly reduced during the process. Besides, the number of newly established cross-shareholding relationships shows an outbreak, which may explain the rapid maintenance of stability in the financial system. When stable clustering is formed before and after a stock crash (rather than when it occurs), the clustering coefficient of clear clustering still has an apparent positive influence on the return rate of stocks. To sum up, the compacted network may prevent the firms from pursuing aggressive earning before the financial crisis, but would protect firms from suffering relatively high losses during and after the shock.


title: PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Models

abstract: Generalizable 3D part segmentation is important but challenging in vision and robotics. Training deep models via conventional supervised methods requires large-scale 3D datasets with fine-grained part annotations, which are costly to collect. This paper explores an alternative way for low-shot part segmentation of 3D point clouds by leveraging a pretrained image-language model, GLIP, which achieves superior performance on open-vocabulary 2D detection. We transfer the rich knowledge from 2D to 3D through GLIP-based part detection on point cloud rendering and a novel 2D-to-3D label lifting algorithm. We also utilize multi-view 3D priors and few-shot prompt tuning to boost performance significantly. Extensive evaluation on PartNet and PartNet-Mobility datasets shows that our method enables excellent zero-shot 3D part segmentation. Our few-shot version not only outperforms existing few-shot approaches by a large margin but also achieves highly competitive results compared to the fully supervised counterpart. Furthermore, we demonstrate that our method can be directly applied to iPhone-scanned point clouds without significant domain gaps.


title: A Global Maximum Principle for Controlled Conditional Mean-field FBSDEs with Regime Switching

abstract: This paper is devoted to a global stochastic maximum principle for conditional mean-field forward-backward stochastic differential equations (FBSDEs, for short) with regime switching. The control domain is unnecessarily convex and the driver of backward stochastic differential equations (BSDEs, for short) could depend on $Z$. Different from the case of non-recursive utility, the first-order and second-order adjoint equations are both high-dimensional linear BSDEs. Based on the adjoint equations, we reveal the relations among the terms of the first- and second-order Taylor's expansions. A general maximum principle is proved, which develops the work of Nguyen, Yin, and Nguyen [22] to recursive utility. As applications, the linear-quadratic problem is considered and a problem with state constraint is studied.


title: High-resolution and reliable automatic target recognition based on photonic ISAR imaging system with explainable deep learning

abstract: Automatic target recognition (ATR) based on inverse synthetic aperture radar (ISAR) images, which is extensively utilized to surveil environment in military and civil fields, must be high-precision and reliable. Photonic technologies' advantage of broad bandwidth enables ISAR systems to realize high-resolution imaging, which is in favor of achieving high-performance ATR. Deep learning (DL) algorithms have achieved excellent recognition accuracies. However, the lack of interpretability of DL algorithms causes the head-scratching problem of credibility. In this paper, we exploit the inner relationship between a photonic ISAR imaging system and behaviors of a convolutional neural network (CNN) to deeply comprehend the intelligent recognition. Specifically, we manipulate imaging physical process and analyze network outputs, the relevance between the ISAR image and network output, and the visualization of features in the network output layer. Consequently, the broader imaging bandwidths and appropriate imaging angles lead to more detailed structural and contour features and the bigger discrepancy among ISAR images of different targets, which contributes to the CNN recognizing and distinguishing objects according to physical laws. Then, based on the photonic ISAR imaging system and the explainable CNN, we accomplish a high-accuracy and reliable ATR. To the best of our knowledge, there is no precedent of explaining the DL algorithms by exploring the influence of the physical process of data generation on network behaviors. It is anticipated that this work can not only inspire the accomplishment of a high-performance ATR but also bring new insights to explore network behaviors and thus achieve better intelligent abilities.


title: A note on $\xi-$Bergman kernels

abstract: In the present note, we introduce the $\xi-$complex singularity exponents, which come from the asymptotic property of $\xi-$Bergman kernels on sub-level sets of plurisubharmonic functions; give some relations (including a closedness property) among $\xi-$complex singularity exponents, complex singularity exponents, and jumping numbers; generalize some properties of complex singularity exponents (such as the restriction formula and subadditivity property) to $\xi-$complex singularity exponents.


title: Understanding the Robustness of Multi-Exit Models under Common Corruptions

abstract: Multi-Exit models (MEMs) use an early-exit strategy to improve the accuracy and efficiency of deep neural networks (DNNs) by allowing samples to exit the network before the last layer. However, the effectiveness of MEMs in the presence of distribution shifts remains largely unexplored. Our work examines how distribution shifts generated by common image corruptions affect the accuracy/efficiency of MEMs. We find that under common corruptions, early-exiting at the first correct exit reduces the inference cost and provides a significant boost in accuracy ( 10%) over exiting at the last layer. However, with realistic early-exit strategies, which do not assume knowledge about the correct exits, MEMs still reduce inference cost but provide a marginal improvement in accuracy (1%) compared to exiting at the last layer. Moreover, the presence of distribution shift widens the gap between an MEM's maximum classification accuracy and realistic early-exit strategies by 5% on average compared with the gap on in-distribution data. Our empirical analysis shows that the lack of calibration due to a distribution shift increases the susceptibility of such early-exit strategies to exit early and increases misclassification rates. Furthermore, the lack of calibration increases the inconsistency in the predictions of the model across exits, leading to both inefficient inference and more misclassifications compared with evaluation on in-distribution data. Finally, we propose two metrics, underthinking and overthinking, that quantify the different behavior of practical early-exit strategy under distribution shifts, and provide insights into improving the practical utility of MEMs.


title: Intelligent Reflecting Surface Assisted Secret Key Generation Under Spatially Correlated Channels in Quasi-Static Environments

abstract: Physical layer key generation (PLKG) can significantly enhance the security of classic encryption schemes by enabling them to change their secret keys significantly faster and more efficient. However, due to the reliance of PLKG techniques on channel medium, reaching a high secret key rate is challenging in static environments. Recently, exploiting intelligent reflecting surface (IRS) as a means to induce randomness in static wireless channels has received significant research interest. However, the impact of spatial correlation between the IRS elements is rarely studied. To be specific, for the first time, in this contribution, we take into account a spatially correlated IRS which intends to enhance the secret key generation (SKG) rate in a static medium. Closed form analytical expressions for SKG rate are derived for the two cases of random phase shift and equal random phase shift for all the IRS elements. We also analyze the temporal correlation between the channel samples to ensure the randomness of the generated secret key sequence. We further formulate an optimization problem in which we determine the optimal portion of time within a coherence interval dedicated for the direct and indirect channel estimation. We show the accuracy and the fast convergence of our proposed sequential convex programming (SCP) based algorithm and discuss the various parameters affecting spatially correlated IRS assisted PLKG.


title: Node and Edge Centrality based Failures in Multi-layer Complex Networks

abstract: Multi-layer complex networks (MLCN) appears in various domains, such as, transportation, supply chains, etc. Failures in MLCN can lead to major disruptions in systems. Several research have focussed on different kinds of failures, such as, cascades, their reasons and ways to avoid them. This paper considers failures in a specific type of MLCN where the lower layer provides services to the higher layer without cross layer interaction, typical of a computer network. A three layer MLCN is constructed with the same set of nodes where each layer has different characteristics, the bottom most layer is Erdos-Renyi (ER) random graph with shortest path hop count among the nodes as gaussian, the middle layer is ER graph with higher number of edges from the previous, and the top most layer is scale free graph with even higher number of edges. Both edge and node failures are considered. Failures happen with decreasing order of centralities of edges and nodes in static batch mode and when the centralities change dynamically with progressive failures. Emergent pattern of three key parameters, namely, average shortest path length (ASPL), total shortest path count (TSPC) and total number of edges (TNE) for all the three layers after node or edge failures are studied. Extensive simulations show that all but one parameters show definite degrading patterns. Surprising, ASPL for the middle layer starts showing a chaotic behavior beyond a certain point for all types of failures.


title: Leveraging Angular Information Between Feature and Classifier for Long-tailed Learning: A Prediction Reformulation Approach

abstract: Deep neural networks still struggle on long-tailed image datasets, and one of the reasons is that the imbalance of training data across categories leads to the imbalance of trained model parameters. Motivated by the empirical findings that trained classifiers yield larger weight norms in head classes, we propose to reformulate the recognition probabilities through included angles without re-balancing the classifier weights. Specifically, we calculate the angles between the data feature and the class-wise classifier weights to obtain angle-based prediction results. Inspired by the performance improvement of the predictive form reformulation and the outstanding performance of the widely used two-stage learning framework, we explore the different properties of this angular prediction and propose novel modules to improve the performance of different components in the framework. Our method is able to obtain the best performance among peer methods without pretraining on CIFAR10/100-LT and ImageNet-LT. Source code will be made publicly available.


title: Distributions of the Wigner reaction matrix for microwave networks with symplectic symmetry in the presence of absorption

abstract: We report on experimental studies of the distribution of the reflection coefficients, and the imaginary and real parts of Wigner's reaction (K) matrix employing open microwave networks with symplectic symmetry and varying size of absorption. The results are compared to analytical predictions derived for the single-channel scattering case within the framework of random matrix theory (RMT). Furthermore, we performed Monte Carlo simulations based on the Heidelberg approach for the scattering (S) and K matrix of open quantum-chaotic systems and the two-point correlation function of the S-matrix elements. The analytical results and the Monte Carlo simulations depend on the size of absorption. To verify them, we performed experiments with microwave networks for various absorption strengths. We show that deviations from RMT predictions observed in the spectral properties of the corresponding closed quantum graph, and attributed to the presence of nonuniversal short periodic orbits, does not have any visible effects on the distributions of the reflection coefficients and the K and S matrices associated with the corresponding open quantum graph.


title: AdaCM: Adaptive ColorMLP for Real-Time Universal Photo-realistic Style Transfer

abstract: Photo-realistic style transfer aims at migrating the artistic style from an exemplar style image to a content image, producing a result image without spatial distortions or unrealistic artifacts. Impressive results have been achieved by recent deep models. However, deep neural network based methods are too expensive to run in real-time. Meanwhile, bilateral grid based methods are much faster but still contain artifacts like overexposure. In this work, we propose the \textbf{Adaptive ColorMLP (AdaCM)}, an effective and efficient framework for universal photo-realistic style transfer. First, we find the complex non-linear color mapping between input and target domain can be efficiently modeled by a small multi-layer perceptron (ColorMLP) model. Then, in \textbf{AdaCM}, we adopt a CNN encoder to adaptively predict all parameters for the ColorMLP conditioned on each input content and style image pair. Experimental results demonstrate that AdaCM can generate vivid and high-quality stylization results. Meanwhile, our AdaCM is ultrafast and can process a 4K resolution image in 6ms on one V100 GPU.


title: Generalizing Multiple Object Tracking to Unseen Domains by Introducing Natural Language Representation

abstract: Although existing multi-object tracking (MOT) algorithms have obtained competitive performance on various benchmarks, almost all of them train and validate models on the same domain. The domain generalization problem of MOT is hardly studied. To bridge this gap, we first draw the observation that the high-level information contained in natural language is domain invariant to different tracking domains. Based on this observation, we propose to introduce natural language representation into visual MOT models for boosting the domain generalization ability. However, it is infeasible to label every tracking target with a textual description. To tackle this problem, we design two modules, namely visual context prompting (VCP) and visual-language mixing (VLM). Specifically, VCP generates visual prompts based on the input frames. VLM joints the information in the generated visual prompts and the textual prompts from a pre-defined Trackbook to obtain instance-level pseudo textual description, which is domain invariant to different tracking scenes. Through training models on MOT17 and validating them on MOT20, we observe that the pseudo textual descriptions generated by our proposed modules improve the generalization performance of query-based trackers by large margins.


title: Computer and Internet Literacy Course of the College of Computer Science for the Municipality of Agoo, La Union

abstract: The main objective of the study is to provide ICT awareness, literacy and skills development to the barangay officials of Agoo, La Union. Specifically, it aimed the following objectives: 1) to determine the profile of the respondents in terms of personal information, educational background and availability of computer unit and background in using computer; 2) to determine the effectiveness of the CILC in terms of services delivered, timeliness of the service, and improvement on the computer and internet knowledge of the trainees; and 3) to determine the level of relevance of the training sessions of the CILC. The study used a descriptive design. Data were gathered by using survey questionnaire and were analyzed by using statistical treatments such as frequency count, percentage and mean. As to the profile of the trainees, the study found that most of the trainees are female (88%); 84% are married, and 56% of them are at the age bracket of 30-39 years old. In terms of educational background, many are high school graduate (n= 17; 68%). In addition, most of them (84%) have background in computer. The result also shows that the CILC is at the high level of effectiveness (4.67) in terms of services delivered and is much relevant (4.45) in terms of its relevance.


title: Two-Player Incomplete Games of Resilient Multiagent Systems

abstract: Evolution of agents' dynamics of multiagent systems under consensus protocol in the face of jamming attacks is discussed, where centralized parties are able to influence the control signals of the agents. In this paper we focus on a game-theoretical approach of multiagent systems where the players have incomplete information on their opponents' strength. We consider repeated games with both simultaneous and sequential player actions where players update their beliefs of each other over time. The effect of the players' optimal strategies according to Bayesian Nash Equilibrium and Perfect Bayesian Equilibrium on agents' consensus is examined. It is shown that an attacker with incomplete knowledge may fail to prevent consensus despite having sufficient resources to do so.


title: A Quantum Algorithm Framework for Discrete Probability Distributions with Applications to R\'enyi Entropy Estimation

abstract: Estimating statistical properties is fundamental in statistics and computer science. In this paper, we propose a unified quantum algorithm framework for estimating properties of discrete probability distributions, with estimating R\'enyi entropies as specific examples. In particular, given a quantum oracle that prepares an $n$-dimensional quantum state $\sum_{i=1}^{n}\sqrt{p_{i}}|i\rangle$, for $\alpha>1$ and $0<\alpha<1$, our algorithm framework estimates $\alpha$-R\'enyi entropy $H_{\alpha}(p)$ to within additive error $\epsilon$ with probability at least $2/3$ using $\widetilde{\mathcal{O}}(n^{1-\frac{1}{2\alpha}}/\epsilon + \sqrt{n}/\epsilon^{1+\frac{1}{2\alpha}})$ and $\widetilde{\mathcal{O}}(n^{\frac{1}{2\alpha}}/\epsilon^{1+\frac{1}{2\alpha}})$ queries, respectively. This improves the best known dependence in $\epsilon$ as well as the joint dependence between $n$ and $1/\epsilon$. Technically, our quantum algorithms combine quantum singular value transformation, quantum annealing, and variable-time amplitude estimation. We believe that our algorithm framework is of general interest and has wide applications.


title: Approximate Message Passing for Multi-Layer Estimation in Rotationally Invariant Models

abstract: We consider the problem of reconstructing the signal and the hidden variables from observations coming from a multi-layer network with rotationally invariant weight matrices. The multi-layer structure models inference from deep generative priors, and the rotational invariance imposed on the weights generalizes the i.i.d.\ Gaussian assumption by allowing for a complex correlation structure, which is typical in applications. In this work, we present a new class of approximate message passing (AMP) algorithms and give a state evolution recursion which precisely characterizes their performance in the large system limit. In contrast with the existing multi-layer VAMP (ML-VAMP) approach, our proposed AMP -- dubbed multi-layer rotationally invariant generalized AMP (ML-RI-GAMP) -- provides a natural generalization beyond Gaussian designs, in the sense that it recovers the existing Gaussian AMP as a special case. Furthermore, ML-RI-GAMP exhibits a significantly lower complexity than ML-VAMP, as the computationally intensive singular value decomposition is replaced by an estimation of the moments of the design matrices. Finally, our numerical results show that this complexity gain comes at little to no cost in the performance of the algorithm.

categories: stat.ML cond-mat.dis-nn cs.IT cs.LG math.IT


title: Cocycles of the space of long embeddings and BCR graphs with more than one loop

abstract: The purpose of this paper is to construct non-trivial cocycles of the space $Emb(\mathbb{R}^j, \mathbb{R}^{n})$ of long embeddings. We construct the cocycles by integral over configuration spaces, associated with Bott-Cattaneo-Rossi graphs with more than one loop. As an application, we give explicitly a non-trivial family of trivial long embeddings for odd $n,j$ with $n-j \geq 2$ and $j \geq 3$. This family (cycle) is constructed from a chord diagram on directed lines. The non-triviality is shown by cocycle-cycle paring, described by paring between graphs and chord diagrams.


title: Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUS

abstract: Deep learning models that leverage large datasets are often the state of the art for modelling molecular properties. When the datasets are smaller (< 2000 molecules), it is not clear that deep learning approaches are the right modelling tool. In this work we perform an extensive study of the calibration and generalizability of probabilistic machine learning models on small chemical datasets. Using different molecular representations and models, we analyse the quality of their predictions and uncertainties in a variety of tasks (binary, regression) and datasets. We also introduce two simulated experiments that evaluate their performance: (1) Bayesian optimization guided molecular design, (2) inference on out-of-distribution data via ablated cluster splits. We offer practical insights into model and feature choice for modelling small chemical datasets, a common scenario in new chemical experiments. We have packaged our analysis into the DIONYSUS repository, which is open sourced to aid in reproducibility and extension to new datasets.


title: Multi-view deep learning based molecule design and structural optimization accelerates the SARS-CoV-2 inhibitor discovery

abstract: In this work, we propose MEDICO, a Multi-viEw Deep generative model for molecule generation, structural optimization, and the SARS-CoV-2 Inhibitor disCOvery. To the best of our knowledge, MEDICO is the first-of-this-kind graph generative model that can generate molecular graphs similar to the structure of targeted molecules, with a multi-view representation learning framework to sufficiently and adaptively learn comprehensive structural semantics from targeted molecular topology and geometry. We show that our MEDICO significantly outperforms the state-of-the-art methods in generating valid, unique, and novel molecules under benchmarking comparisons. In particular, we showcase the multi-view deep learning model enables us to generate not only the molecules structurally similar to the targeted molecules but also the molecules with desired chemical properties, demonstrating the strong capability of our model in exploring the chemical space deeply. Moreover, case study results on targeted molecule generation for the SARS-CoV-2 main protease (Mpro) show that by integrating molecule docking into our model as chemical priori, we successfully generate new small molecules with desired drug-like properties for the Mpro, potentially accelerating the de novo design of Covid-19 drugs. Further, we apply MEDICO to the structural optimization of three well-known Mpro inhibitors (N3, 11a, and GC376) and achieve ~88% improvement in their binding affinity to Mpro, demonstrating the application value of our model for the development of therapeutics for SARS-CoV-2 infection.


title: Microstructure Evolution of Solid Oxide Fuel Cell Anodes Characterized by Persistent Homology

abstract: Uncovering microstructure evolution mechanisms that accompany the long-term operation of solid oxide fuel cells is a fundamental challenge in designing a more durable energy system for the future. To date, the study of fuel cell stack degradation has focused mainly on electrochemical performance and, more rarely, on averaged microstructural parameters. Here we show an alternative approach in which an evolution of three-dimensional microstructural features is studied using electron tomography coupled with topological data analysis. The latter produces persistent images of microstructure before and after long-term operation of electrodes. Those images unveil a new insight into the degradation process of three involved phases: nickel, pores, and yttrium-stabilized zirconium.


title: A Domain-specific Perceptual Metric via Contrastive Self-supervised Representation: Applications on Natural and Medical Images

abstract: Quantifying the perceptual similarity of two images is a long-standing problem in low-level computer vision. The natural image domain commonly relies on supervised learning, e.g., a pre-trained VGG, to obtain a latent representation. However, due to domain shift, pre-trained models from the natural image domain might not apply to other image domains, such as medical imaging. Notably, in medical imaging, evaluating the perceptual similarity is exclusively performed by specialists trained extensively in diverse medical fields. Thus, medical imaging remains devoid of task-specific, objective perceptual measures. This work answers the question: Is it necessary to rely on supervised learning to obtain an effective representation that could measure perceptual similarity, or is self-supervision sufficient? To understand whether recent contrastive self-supervised representation (CSR) may come to the rescue, we start with natural images and systematically evaluate CSR as a metric across numerous contemporary architectures and tasks and compare them with existing methods. We find that in the natural image domain, CSR behaves on par with the supervised one on several perceptual tests as a metric, and in the medical domain, CSR better quantifies perceptual similarity concerning the experts' ratings. We also demonstrate that CSR can significantly improve image quality in two image synthesis tasks. Finally, our extensive results suggest that perceptuality is an emergent property of CSR, which can be adapted to many image domains without requiring annotations.


title: High-Speed Resource Allocation Algorithm Using a Coherent Ising Machine for NOMA Systems

abstract: Non-orthogonal multiple access (NOMA) technique is important for achieving a high data rate in next-generation wireless communications. A key challenge to fully utilizing the effectiveness of the NOMA technique is the optimization of the resource allocation (RA), e.g., channel and power. However, this RA optimization problem is NP-hard, and obtaining a good approximation of a solution with a low computational complexity algorithm is not easy. To overcome this problem, we propose the coherent Ising machine (CIM) based optimization method for channel allocation in NOMA systems. The CIM is an Ising system that can deliver fair approximate solutions to combinatorial optimization problems at high speed (millisecond order) by operating optimization algorithms based on mutually connected photonic neural networks. The performance of our proposed method was evaluated using a simulation model of the CIM. We compared the performance of our proposed method to simulated annealing, a conventional-NOMA pairing scheme, deep Q learning based scheme, and an exhaustive search scheme. Simulation results indicate that our proposed method is superior in terms of speed and the attained optimal solutions.


title: Box2Mask: Box-supervised Instance Segmentation via Level-set Evolution

abstract: In contrast to fully supervised methods using pixel-wise mask labels, box-supervised instance segmentation takes advantage of simple box annotations, which has recently attracted increasing research attention. This paper presents a novel single-shot instance segmentation approach, namely Box2Mask, which integrates the classical level-set evolution model into deep neural network learning to achieve accurate mask prediction with only bounding box supervision. Specifically, both the input image and its deep features are employed to evolve the level-set curves implicitly, and a local consistency module based on a pixel affinity kernel is used to mine the local context and spatial relations. Two types of single-stage frameworks, i.e., CNN-based and transformer-based frameworks, are developed to empower the level-set evolution for box-supervised instance segmentation, and each framework consists of three essential components: instance-aware decoder, box-level matching assignment and level-set evolution. By minimizing the level-set energy function, the mask map of each instance can be iteratively optimized within its bounding box annotation. The experimental results on five challenging testbeds, covering general scenes, remote sensing, medical and scene text images, demonstrate the outstanding performance of our proposed Box2Mask approach for box-supervised instance segmentation. In particular, with the Swin-Transformer large backbone, our Box2Mask obtains 42.4% mask AP on COCO, which is on par with the recently developed fully mask-supervised methods. The code is available at: https://github.com/LiWentomng/boxlevelset.


title: Residual categories of Grassmannians

abstract: This short note is an extended abstract for my talk at the Nottingham Online Algebraic Geometry Seminar on October 1, 2020. It is based on the joint works with Alexander Kuznetsov arXiv:1802.08097 and arXiv:2001.04148.


title: Modeling Label Correlations for Ultra-Fine Entity Typing with Neural Pairwise Conditional Random Field

abstract: Ultra-fine entity typing (UFET) aims to predict a wide range of type phrases that correctly describe the categories of a given entity mention in a sentence. Most recent works infer each entity type independently, ignoring the correlations between types, e.g., when an entity is inferred as a president, it should also be a politician and a leader. To this end, we use an undirected graphical model called pairwise conditional random field (PCRF) to formulate the UFET problem, in which the type variables are not only unarily influenced by the input but also pairwisely relate to all the other type variables. We use various modern backbones for entity typing to compute unary potentials, and derive pairwise potentials from type phrase representations that both capture prior semantic information and facilitate accelerated inference. We use mean-field variational inference for efficient type inference on very large type sets and unfold it as a neural network module to enable end-to-end training. Experiments on UFET show that the Neural-PCRF consistently outperforms its backbones with little cost and results in a competitive performance against cross-encoder based SOTA while being thousands of times faster. We also find Neural- PCRF effective on a widely used fine-grained entity typing dataset with a smaller type set. We pack Neural-PCRF as a network module that can be plugged onto multi-label type classifiers with ease and release it in https://github.com/modelscope/adaseq/tree/master/examples/NPCRF.


title: The Chv\'atal-Sankoff problem: Understanding random string comparison through stochastic processes

abstract: Given two equally long, uniformly random binary strings, the expected length of their longest common subsequence (LCS) is asymptotically proportional to the strings' length. Finding the proportionality coefficient $\gamma$, i.e. the limit of the normalised LCS length for two random binary strings of length $n \to \infty$, is a very natural problem, first posed by Chv\'atal and Sankoff in 1975, and as yet unresolved. This problem has relevance to diverse fields ranging from combinatorics and algorithm analysis to coding theory and computational biology. Using methods of statistical mechanics, as well as some existing results on the combinatorial structure of LCS, we link constant $\gamma$ to the parameters of a certain stochastic particle process. These parameters are determined by a specific (large) system of polynomial equations with integer coefficients, which implies that $\gamma$ is an algebraic number. Short of finding an exact closed-form solution for such a polynomial system, which appears to be unlikely, our approach essentially resolves the Chv\'atal-Sankoff problem, albeit in a somewhat unexpected way with a rather negative flavour.


title: A Multi-layered GaGeTe Electro-Optic Device Integrated in Silicon Photonics

abstract: Electrically tunable devices contribute significantly to key functions of photonics integrated circuits. Here, we demonstrate the tuning of the optical index of refraction based on hybrid integration of multi-layered anisotropic GaGeTe on a silicon micro-ring resonator (Si-MRR). Under static applied (DC) bias and transverse-electric (TE) polarization, the device exhibits a linear resonance shift without any amplitude modulation. However, for the transverse-magnetic (TM) polarization, both amplitude and phase modulation are observed. The corresponding wavelength shift and half-wave voltage length product (V_{\pi}.l) for the TE polarization are 1.78 pm/V and 0.9 V.cm, respectively. These values are enhanced for the TM polarizations and correspond to 6.65 pm/V and 0.28 V.cm, respectively. The dynamic radio frequency (RF) response of the devices was also tested at different bias conditions. Remarkably, the device exhibits a 1.6 MHz and 2.1 MHz response at 0 V and 7 V bias, respectively. Based on these findings, the integration of 2D GaGeTe on the silicon photonics platform has great potential for the next generation of integrated photonic applications such as switches and phase shifters.


title: A comprehensive study of cotton price fluctuations using multiple Econometric and LSTM neural network models

abstract: This paper proposes a new coherent model for a comprehensive study of the cotton price using econometrics and Long-Short term memory neural network (LSTM) methodologies. We call a simple cotton price trend and then assumed conjectures in structural method (ARMA), Markov switching dynamic regression, simultaneous equation system, GARCH families procedures, and Artificial Neural Networks that determine the characteristics of cotton price trend duration 1990-2020. It is established that in the structural method, the best procedure is AR (2) by Markov switching estimation. Based on the MS-AR procedure, it concludes that tending to regime change from decreasing trend to an increasing one is more significant than a reverse mode. The simultaneous equation system investigates three procedures based on the acreage cotton, value-added, and real cotton price. Finally, prediction with the GARCH families TARCH procedure is the best-fitting model, and in the LSTM neural network, the results show an accurate prediction by the training-testing method.


title: Witnessing quantum chaos using observational entropy

abstract: We study observation entropy (OE) for the Quantum kicked top (QKT) model, whose classical counterpart possesses different phases: regular, mixed, or chaotic, depending on the strength of the kicking parameter. We show that OE grows logarithmically with coarse-graining length beyond a critical value in the regular phase, while OE growth is much faster in the chaotic regime. In the dynamics, we demonstrate that the short-time growth rate of OE acts as a measure of the chaoticity in the system, and we compare our results with out-of-time-ordered correlators (OTOC). Moreover, we show that in the deep quantum regime, the results obtained from OE are much more robust compared to OTOC results. Finally, we also investigate the long-time behaviour of OE to distinguish between saddle-point scrambling and true chaos, where the former shows large persistent fluctuations compared to the latter.


title: Transversality of the perturbed reduced Vafa-Witten moduli spaces on 4-manifolds

abstract: Previously we finish the establishment of the transversality of the general part of the Vafa-Witten moduli spaces, in this paper, we deal with the rest, i.e., the reduced part. We consider Vafa-Witten equation on closed, oriented and smooth Riemann 4-manifolds with $C\equiv0$, and construct perturbation to establish the transversality of the perturbed equation. Then we show that for a generic choice of the perturbation terms, the moduli space of solutions to the perturbed reduced Vafa-Witten equation for the structure group $SU(2)$ or $SO(3)$ on a closed 4-manifold is a smooth manifold of dimension zero.


title: Efficient Multiple Exciton Generation in Monolayer MoS2

abstract: Utilizing the excess energy of photoexcitation that is otherwise lost as thermal effects can improve the efficiency of next-generation light-harvesting devices. Multiple exciton generation (MEG) in semiconducting materials yields two or more excitons by absorbing a single high-energy photon, which can break the Shockley-Queisser limit for the conversion efficiency of photovoltaic devices. Recently, monolayer transition metal dichalcogenides (TMDs) have emerged as promising light-harvesting materials because of their high absorption coefficient. Here, we report efficient MEG with low threshold energy and high (86%) efficiency in a van der Waals (vdW) layered material, MoS2. Through different experimental approaches, we demonstrate the signature of exciton multiplication and discuss the possible origin of decisive MEG in monolayer MoS2. Our results reveal that vdW-layered materials could be a potential candidate for developing mechanically flexible and highly efficient next generation solar cells and photodetectors.